147 results about "Facial motion" patented technology

A system and method for capturing motion comprises a motion capture volume adapted to contain at least one actor having body markers defining plural body points and facial markers defining plural facial points. A plurality of body motion cameras and a plurality of facial motion cameras are arranged around a periphery of the motion capture volume. The facial motion cameras each have a respective field of view narrower than a corresponding field of view of the body motion cameras. The facial motion cameras are arranged such that all laterally exposed surfaces of the actor while in motion within the motion capture volume are within the field of view of at least one of the plurality of facial motion cameras at substantially all times. A motion capture processor is coupled to the plurality of facial motion cameras and the plurality of body motion cameras to produce a digital model reflecting combined body and facial motion of the actor. At least one microphone may be oriented to pick up audio from the motion capture volume.

A system and method for capturing motion comprises a motion capture volume adapted to contain at least one actor having body markers defining plural body points and facial markers defining plural facial points. A plurality of motion cameras are arranged around a periphery of the motion capture volume. The motion cameras are arranged such that all laterally exposed surfaces of the actor while in motion within the motion capture volume are within the field of view of at least one of the plurality of the motion cameras at substantially all times. A motion capture processor is coupled to the plurality of motion cameras to produce a digital model reflecting combined body and facial motion of the actor. At least one microphone may be oriented to pick up audio from the motion capture volume.

The present invention provides a method of controlling a virtual object or instruction for a computing device comprising: detecting a user activity by a detecting device; generating a control signal in responsive to the user activity detection; controlling an object displayed on a display in responsive to the control signal to execute the instruction. The user activity is detected by CMOS or CCD. The user activity includes facial motion, eye motion, or finger motion.

The embodiment of the invention discloses a method for realizing face animation based on motion unit expression mapping, and relates to the technical field of deep learning and face animation, the method for realizing face animation comprises the following steps: redefining 24 face motion units by utilizing a face motion coding system; collecting video data, marking the facial motion unit of eachframe of image in the video data by using expression quantification software, and establishing a facial expression data set; carrying out face detection on the labeled face expression data set, and carrying out feature extraction by utilizing a convolutional neural network; constructing a regression network model for regression of the motion unit parameters based on the three-layer neural networkin combination with the extracted features; and driving the virtual character to realize face animation by using a regression network model and combining the new expression coding system and the expression fusion model. According to the method, the problems that an existing method for realizing the facial animation is not high in applicability and cannot accurately describe facial expression changes by directly utilizing two-dimensional features can be solved.

The invention discloses an artificial-intelligence-based abnormal eyelid movement evaluation system. The system comprises an examined object obtaining module, an eye and specific part positioning module, a TSN model, a probability output module and an evaluation module; the examined object obtaining module is used for obtaining a facial video which is obtained from a facial movement video of the input examined object and only contains the examined object, the eye and specific part positioning module is used for positioning the eye and specific part of the facial video and obtaining an eye movement video and a specific part linkage video which only contain the examined object, the TSN model is used for processing the eye movement video and the specific part linkage video and outputting movement signals of eyes and specific parts, the probability output module is used for outputting probability signals appearing when a computer judges that eyelid movement is abnormal in each frame, and the evaluation module is used for obtaining the abnormal level according to the probability signals appearing in abnormal eyelid movement and an abnormal eyelid movement probability judging mechanism.Accordingly, universal acceptability, convenience, accuracy, objectivity and repeatability are achieved, and the clinical applicability is high.