44 results about "Visual modality" patented technology

The present invention relates to a method for assessing a learner's pronunciation through voices and images, in which variation of the teacher's and the learner's lips are compared in a visual manner. Accordingly, incorrect pronunciation can be pointed out and recorded for assessment and rectification.

A method and system for use in a user system, for accessing information related to a physical document. An electronic copy of an existing physical document is identified and located. The electronic copy of the physical document is an exact replica of the physical document. One or more pages of the physical document are identified. A selected part of the physical document is identified using the position of points on the identified one or more pages of the physical document and in response, data related to the selected part of the physical document is retrieved from the electronic copy of the physical document. The retrieved data is presented visually to a visually impaired person or orally to a blind person on the user system, which enables the visually impaired person to see or hear, respectively, the retrieved data.

The present invention claims and discloses a color and, or symbol coded display on a digital interactive badge for communicating a permission to approach and activate further digital content interaction. A non-verbal person to person ‘line of sight’ digital or electronic communication protocol standard (NVP) which allows one person to communicate with another using a direct line of sight signal from one interactive badge or screen to another. It allows the user to communicate and display their feelings, emotions, states of mind and consciousness, their like-mindedness with others, their social media activity, images, favorite brands, videos, purchased items and advertising all inside a new and comprehensive language NVP and in a visual way. NVP also allows the user to send invites to approach, talk, interact and to send digital information to their NVP capable interactive badge or screen or static receiver. NVP has been designed to run on hardware that can be programmed from the NVP interface and is designed specifically for the wearable technology market.

Disclosed herein are systems and methods for converting audio-video content into audio-only content. Audio-video content is readily accessible, but for various reasons users often cannot consume content visually. In those circumstances, for example, when a user is interrupted during a movie to drive to pick up a spouse or child, the user may not want to forego consuming the audio-video content. The audio-video content can be converted into audio only content for the user to aurally consume, allowing the user to consume the content despite interruptions or other reasons for which the audio-video content cannot be consumed visually.

A voice detection method, a training method of a prediction model, a device, equipment and a medium, belonging to the technical field of voice interaction. A multi-modal speech end point detection method, which uses the model to recognize the captured face image, thereby predicting whether the user has the intention to continue speaking, combined with the prediction results, to determine whether the collected audio signal is the speech end point , because on the basis of the acoustic features, the features of the visual modality of the face image are also integrated for detection, even when the background noise is strong or the user pauses during speech, the face image can be used to accurately judge Whether the voice signal is the end point of the voice, thus avoiding the interference caused by background noise and speech pauses, thereby avoiding the problem of too late or premature detection of the end of the voice interaction caused by the interference of background noise and speech pauses, and improving the Accuracy in detecting speech end points.

The invention relates to a lubricating oil film level tester and a test method thereof. The tester includes a capacitance sensor arranged in an oil tank and a measurement module connected to the capacitance sensor. The measurement module includes a processor configured to is: Obtain the first measured value ε for the first medium representing the lowest oil film level min , to obtain a second measurement ε for the second medium representing the highest oil film level max , to obtain the third measured value ε of the third medium measured by the capacitive sensor x , calculate the oil film level of the third medium and feedback it to the user through visual and / or auditory means, where the first measured value ε min , the second measured value ε max and the third measured value ε x They are proportional to the first dielectric coefficient of the first medium, the second dielectric coefficient of the second medium, and the third dielectric coefficient of the third medium, and the proportional ratios are the same. The third medium is unused lubricating Oil.

The invention provides a multi-modality vocabulary representing method. The multi-modality vocabulary representing method comprises the steps of calculating a text representing vector of a vocabulary to be represented in text modality and a picture representing vector of the vocabulary to be represented in visual modality; inputting the text representing vector into a pre-established text modality weight model to obtain the weight of the text representing vector in the text modality; inputting the picture representing vector into a pre-established visual modality weight model to obtain the weight of the picture representing vector in picture modality; conducting calculation to obtain a multi-modality vocabulary representing vector according to the text representing vector, the picture representing vector and weights corresponding to the text representing vector and the picture representing vector respectively. The text modality weight model is a neural network model of which input is the text representing vector and output is the weight of the text representing vector in the corresponding text modality; the visual modality weight model is a neural network model of which input is the picture representing vector and output is the weight of the picture representing vector in the corresponding visual modality.

The present invention is to provide a terminal for performing a secretarial function for assisting a person's memory at home or in a company, and a system comprising the same. The terminal comprises: a camera module configured to capture an image of a predetermined space when a person's motion in the predetermined space is detected; and a memory for storing the image captured by the camera module, wherein when a user request is received, the position of an object corresponding to the user request is detected using the image stored in the memory, and guide information can be outputted in at least one manner of a visual manner, an auditory manner and a tactile manner so that the detected position is guided.

The present invention proposes a device and method for clock calibration. The current clock time of the clock is photographed in real time by using the camera module in a visual way. The image processing unit receives the current clock time image and processes the image data according to an algorithm to obtain the adjusted clock time. , obtain the adjusted clock time, align the origin of the clock calibration device with the clock origin, absorb the clock hands, and adjust the clock time according to the obtained adjusted clock time. The present invention utilizes the cyclic data processing mode of the image processing unit to obtain the current clock of the watch for precise calibration, which is more convenient, more efficient and more intelligent.