Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for constructing virtual video based on FPGA, storage medium and equipment

A technology in virtual video and video, applied in the computer field, can solve the problems of inability to build virtual video, high power consumption, etc., and achieve good real-time performance and low delay

Active Publication Date: 2020-08-21
安徽文香科技有限公司
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the high-performance x86 processor can handle real-time image matting, its power consumption is very large, and the common ARM and PowerPC processors corresponding to embedded systems are basically unable to realize the construction of virtual video

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for constructing virtual video based on FPGA, storage medium and equipment
  • Method and device for constructing virtual video based on FPGA, storage medium and equipment
  • Method and device for constructing virtual video based on FPGA, storage medium and equipment

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0061] see figure 1 , a schematic flow diagram of a method for constructing a virtual video based on FPGA provided in this embodiment, the method is applied to an FPGA chip, and specifically includes the following steps:

[0062] S101: Obtain the pixel value of the pixel point in the foreground and the opacity value of the foreground of each frame of image in the video to be keyed.

[0063] In this embodiment, any video for virtual video construction using this embodiment is defined as a video signal to be keyed. Each frame of the video to be keyed includes a background and a foreground where a target composite object (such as a person or a vehicle, etc.) is located. Further, existing or future image keying methods can be used to perform keying processing on each frame of the video to be keyed. For example, the method of chroma key keying can be used to perform keying processing on each frame of image, so as to accurately obtain The pixel values ​​of the pixels in the backgr...

no. 2 example

[0141] This embodiment will introduce an FPGA-based device for constructing a virtual video. For related content, please refer to the foregoing method embodiments.

[0142] see figure 2 , which is a schematic composition diagram of a device for constructing virtual video based on FPGA provided in this embodiment. The device is applied to an FPGA chip, and specifically includes:

[0143] The first obtaining unit 201 is used to obtain the pixel value of the pixel point in the foreground of each frame of image in the video to be keyed and the opacity value of the foreground;

[0144] A synchronization unit 202, configured to input the pixel value of the pixel in the foreground, the opacity value of the foreground, and the virtual background into the cache DDR, and perform frame synchronization through the DDR to obtain a synchronization result;

[0145] The second acquisition unit 203 is configured to acquire the target image frame by frame from the synchronization result, and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and a device for constructing a virtual video based on an FPGA, a storage medium and equipment. The method comprises the following steps: the FPGA firstly obtaining pixel values of pixel points in a foreground of each frame of image in a to-be-matted video and opaqueness values of the foreground; inputting the pixel value of the pixel point in the foreground, the opacity value of the foreground and the virtual background into a cache DDR; performing frame synchronization through DDR, obtaining a synchronization result; then obtaining a target image frame by frame from the synchronization result, taking each pixel point in the target image as a to-be-synthesized point, and further converting the to-be-synthesized point according to a pixel value and an opacity value of the to-be-synthesized point so as to obtain a corresponding pixel point of the to-be-synthesized point in a virtual video. Visibly, according to the embodiment of the invention, the construction of the virtual interactive video is realized through pure FPGA hardware, and the same clock period is ensured in all calculation processes, so that the constructed virtual video can be better in real-time performance and relatively small in delay (only 1-2 frames).

Description

technical field [0001] The present application relates to the field of computer technology, and in particular to a method, device, storage medium and equipment for constructing virtual video based on FPGA. Background technique [0002] With the development of video technology in the direction of digitalization and multimedia, people's demand for visual perception continues to increase, and the video object extraction technology represented by virtual video has shown broad application prospects. Keying technology is also widely used in news broadcasts, movie special effects and other occasions. [0003] In the traditional method of constructing virtual video, a high-end processor in x86 is usually used to realize the keying function. In low-power embedded systems, there is no precedent for embedded systems. Corresponding to the decoded video, to complete the real-time video keying function, for the traditional CPU of serial processing, it is impossible to provide perfect re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T5/00G06T5/30G06T5/50G06T7/194G06T7/90
CPCG06T7/194G06T7/90G06T5/30G06T5/50G06T2207/20221G06T5/70
Inventor 朱玉荣郭旭
Owner 安徽文香科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com