A construction method of a virtual piano playing system based on Kinect
A construction method and piano technology, applied to the details of the processing steps, the input/output process of data processing, instruments, etc., can solve the problems that are difficult to imitate the effect of playing piano keys, difficult to satisfy professional users, and difficult to achieve sound effects and other issues, to achieve good user experience, three-dimensional picture effects, and satisfying immersive experience
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment Construction
[0051] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.
[0052] Step 1: 3D reconstruction of the scene
[0053] Turn on the camera of the Kinect device, capture the spatial depth information, use the camera to obtain the depth information of the real image, calculate the point cloud coordinates of each pixel in each frame of the depth image, perform triangulation calculation on the point cloud coordinates, and use the triangulation The coordinate information and depth information of each pixel point calculate the normal vector of the pixel point to realize three-dimensional reconstruction;
[0054] The detailed steps are as follows:
[0055] Step 1.1: Depth map acquisition
[0056] Use Microsoft's Kinect SDK to control Kinect, use Open Frameworks for 3D drawing, set the total number of point clouds for OpenGL and 3D scenes when starting 3D reconstruction, and draw the key area of the virtual piano on the ...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com