Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Three-dimensional reconstruction method and device of multi-lens camera, VR (Virtual Reality) camera and panorama camera

A multi-eye camera and three-dimensional reconstruction technology, which is applied in 3D modeling, computer parts, character and pattern recognition, etc., can solve the problems of poor robustness and achieve increased robustness, increased coincidence, and wide field of view corner effect

Active Publication Date: 2018-09-21
SHENZHEN ARASHI VISION CO LTD
View PDF7 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The object of the present invention is to provide a three-dimensional reconstruction method, device, computer-readable storage medium, VR camera and panoramic camera of a multi-eye camera, aiming to solve the robustness of three-dimensional reconstruction based on images collected by a multi-eye camera with ordinary lenses poor problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional reconstruction method and device of multi-lens camera, VR (Virtual Reality) camera and panorama camera
  • Three-dimensional reconstruction method and device of multi-lens camera, VR (Virtual Reality) camera and panorama camera
  • Three-dimensional reconstruction method and device of multi-lens camera, VR (Virtual Reality) camera and panorama camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0025] see figure 1 , the three-dimensional reconstruction method of the multi-eye camera provided in Embodiment 1 of the present invention includes the following steps: It should be noted that, if there are substantially the same results, the three-dimensional reconstruction method of the multi-eye camera of the present invention does not use figure 1 The flow sequence shown is limited.

[0026] S101. Obtain a video captured by each camera during the movement of the multi-camera.

[0027] In Embodiment 1 of the present invention, the multi-eye camera may be a VR camera or a panoramic camera including at least two cameras, such as figure 2 The multi-eye camera shown includes 6 cameras arranged at equal intervals in a circular shape, and of course, may include 3, 4, 5, 8, or even more than 8 cameras. VR cameras and panoramic cameras usually use fisheye lenses or wide-angle lenses.

[0028] In Embodiment 1 of the present invention, S101 may be specifically: Acquiring videos ...

Embodiment 2

[0061] see image 3 , the three-dimensional reconstruction device of the multi-eye camera provided in Embodiment 2 of the present invention includes:

[0062] The video acquisition module 11 is used to acquire the video taken by each camera during the moving process of the multi-eye camera;

[0063] Key frame extracting module 12, is used for extracting key frame simultaneously to the video that all camera shoots, and does distortion correction to each key frame;

[0064] The three-dimensional reconstruction module 13 is used to perform three-dimensional reconstruction according to the key frames corresponding to the videos taken by all cameras, and generate point clouds and camera poses of the cameras;

[0065] The point cloud processing module 14 is configured to acquire common point clouds generated by adjacent cameras, and determine scales of all point clouds according to the common point clouds generated by adjacent cameras.

[0066] The 3D reconstruction device for a m...

Embodiment 3

[0068] Embodiment 3 of the present invention provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the three-dimensional Steps of the reconstruction method.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention is suitable for the field of computer vision and provides a three-dimensional reconstruction method and device of a multi-lens camera, a VR (Virtual Reality) camera and a panorama camera. The method comprises the following steps of: obtaining videos shot by each camera in the moving process of the multi-lens camera, wherein the multi-lens camera is a VR camera or a panorama camera comprising at least two cameras; simultaneously extracting key frames from the videos shot by all the cameras and correcting the distortion of each key frame; carrying out three-dimensional reconstruction according to the key frames corresponding to the videos shot by all the cameras to generate point clouds and camera postures of the cameras; and obtaining common point clouds generated by the adjacent cameras and determining scales of all the point clouds according to the common point clouds generated by the adjacent cameras. The method provided by the invention has the advantages that the specific real physical scales can be provided for the point clouds; a wider viewing angle can be provided and a more complete angle can be covered by using the lens of the VR camera or the panorama camera; the coincidence degree of two adjacent lenses is simultaneously increased to provide more common points for determining the scales of the point clouds; and the robustness is increased.

Description

technical field [0001] The invention belongs to the field of computer vision, and in particular relates to a three-dimensional reconstruction method and device of a multi-eye camera, a VR camera and a panoramic camera. Background technique [0002] In the prior art, for the positioning and navigation of robots, a common lens-based multi-eye camera is usually used to collect images, and then three-dimensional reconstruction is performed through the SFM (Structure From Motion, motion recovery structure) algorithm. However, the field of view of ordinary lenses is relatively narrow, the collected images cannot cover a complete angle, and the coincidence degree of two adjacent lenses is relatively low, so the robustness of 3D reconstruction is poor. Contents of the invention [0003] The object of the present invention is to provide a three-dimensional reconstruction method, device, computer-readable storage medium, VR camera and panoramic camera of a multi-eye camera, aiming t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/55G06K9/00
CPCG06T7/55G06T2207/10016G06T17/00G06T7/80G06V20/46G06T7/579G06T7/593G06T2207/10021G06T2200/08
Inventor 谢亮
Owner SHENZHEN ARASHI VISION CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com