Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Human body motion capture method and device based on IK algorithm, medium and equipment

A technology of human motion and algorithm, applied in the field of virtual reality, can solve the problems of restricting the development of the industry, restricting the user experience, and lack of synchronization of body posture.

Inactive Publication Date: 2020-08-14
SHANGHAI GRAPHIC DIGITAL INFORMATION CO LTD
View PDF3 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, in the interactive large-space VR solution, only the information of the player's hands and head can be tracked. As a result, players can only see the exact position of the head and hands of each other in the virtual space where they coexist, but there is no complete body Attitude Synchronization
This greatly reduces the immersion and interactive realism of VR, limits the user experience, and limits the development of the industry

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human body motion capture method and device based on IK algorithm, medium and equipment
  • Human body motion capture method and device based on IK algorithm, medium and equipment
  • Human body motion capture method and device based on IK algorithm, medium and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] figure 1 It is a flow chart of the human body motion capture method based on the IK algorithm provided by Embodiment 1 of the present invention. This embodiment is applicable to the situation of human body motion capture based on the IK algorithm. The human body motion capture device can be implemented, and the device can be implemented by software and / or hardware, and can be integrated into electronic equipment such as a human body tracking system for virtual reality.

[0043] like figure 1 Shown, described human motion capture method based on IK algorithm comprises:

[0044] S110. Obtain the target marker point of the user in the initial pose, determine the serial number and joint type of the target marker point, and save the initial pose model.

[0045] Wherein, the user's initial posture may be a T-shaped posture with both arms raised flat, and in this posture, it is helpful to determine the marking points on each joint position of the user. The target marker poi...

Embodiment approach

[0071] In order to allow those skilled in the art to understand the solution more clearly, the application also provides specific preferred implementations as follows:

[0072] figure 2 It is a schematic diagram of the human body motion capture process based on the IK algorithm provided by Embodiment 1 of the present invention. like figure 2 Shown, the present invention process mainly comprises the following steps:

[0073] Obtain user images through n tracking cameras;

[0074] Get a synchronized image dataset;

[0075] Determine whether the camera has been calibrated successfully, if it has been calibrated, proceed to the following steps, if not, perform camera calibration of n tracking cameras;

[0076] Use Kalman filter to predict the position P of the current frame for the marker in the previous frame image;

[0077] The estimated position P is back-projected to all cameras, and the corresponding image points p1, p2, ..., pn are found;

[0078] Traverse all marker...

Embodiment 2

[0111] image 3 It is a schematic structural diagram of the human body motion capture device based on the IK algorithm provided by Embodiment 2 of the present invention. like image 3 As shown, the human motion capture device based on the IK algorithm includes:

[0112] The target marker point determination module 310 is used to obtain the target marker point of the user under the initial posture, determine the sequence number and joint type of the target marker point, and save the initial posture model;

[0113] The position prediction module 320 is used to track the image information captured in real time, and predict the position of the target mark point in the current frame image according to the position of the target mark point in the previous frame image;

[0114] The missing mark point correction module 330 is used for if there is a target mark point loss in the current frame image, the IK algorithm is used to calculate the lost target mark point in the predicted cur...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a human body motion capture method and device based on an IK algorithm, a medium and equipment. The method comprises the following steps: acquiring a target mark point of a user in an initial posture; tracking the image information captured in real time, and predicting the position of the target mark point in the current frame of image according to the position of the target mark point in the previous frame of image; if the target mark point loss exists in the current frame of image, correcting the position of the lost target mark point in the predicted current frame of image by adopting the IK algorithm according to the tracked target mark point closest to the lost target mark point; and determining the current posture of the user according to theinitial posture model and the correction result of the position of the lost target mark point. All parts of the human body can be tracked and predicted based on the IK algorithm according to the tracking result of the main parts of the body of the user, and the purpose of displaying the whole body of the user in real time can be achieved.

Description

technical field [0001] Embodiments of the present invention relate to the field of virtual reality technology, and in particular, to a human body motion capture method, device, medium and equipment based on an IK algorithm. Background technique [0002] With the rapid development of science and technology, virtual reality technology has been gradually pushed into people's leisure and entertainment life. [0003] For virtual reality technology, taking VR as an example, most users are familiar with VR devices such as HTC VIVE, Oculus Rift, PSVR and other head-mounted devices. These head-mounted devices all have a common feature, that is, they can only track part of the user's body organs, such as only the user's head, hands and other parts. [0004] At present, in the interactive large-space VR solution, only the information of the player's hands and head can be tracked. As a result, players can only see the exact position of the head and hands of each other in the virtual sp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06T7/246G06T7/80
CPCG06T7/251G06T7/80G06T2207/30196G06T2207/30204G06V40/23
Inventor 周清会汤代理毛佳红
Owner SHANGHAI GRAPHIC DIGITAL INFORMATION CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products