Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Visual semantics and position sensing method and system based on infrared thermal imaging

An infrared thermal imaging and thermal imaging technology, applied in the field of visual recognition, can solve the problems of large imaging difference, inaccurate positioning, and easy reflection of mirror objects, etc., and achieve the goal of improving accuracy and stability, and robust visual recognition and positioning Effect

Inactive Publication Date: 2020-06-30
TSINGHUA UNIV +1
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, 3D depth cameras are used to locate objects. The problem with this positioning method is that the point cloud image is not dense enough, and mirror objects are prone to reflection, making the positioning imprecise.
The difficulty of visual recognition in the prior art is that it is easily disturbed by the external environment, such as occlusion between objects, light and dark changes of objects caused by light, etc.
The existing technology uses RGB images that are easily affected by indoor and outdoor light; there is a big difference between daytime and nighttime imaging; special supplementary light equipment is required to stabilize the imaging
When the heat radiation object is blocked, such as when a person wearing a mask, a hat, etc. covers the face and head for imaging, it is impossible to accurately judge

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Visual semantics and position sensing method and system based on infrared thermal imaging
  • Visual semantics and position sensing method and system based on infrared thermal imaging
  • Visual semantics and position sensing method and system based on infrared thermal imaging

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] The invention discloses a visual semantics and position perception method based on infrared thermal imaging, which includes the following steps:

[0045] Step S1, process, classify and instance-segment the obtained thermal imaging images through the deep neural network, and obtain a set of image categories and mask packaging images with confidence.

[0046] Semantics in the image field refers to the understanding of the content of the image and the meaning expressed by the image. Visual semantics (Visual semantics) refers to the result of the gradual accumulation of non-linguistic semantic information, such as the type and color of an item, or the movement characteristics of a certain animal or someone.

[0047] Obtaining the thermal image is accomplished using the thermal image capture module, which captures the thermal image for processing by the neural network. The specific implementation steps are as follows:

[0048] Step S101, in the linux system (such as Ubuntu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a visual semantics and position sensing method and system based on infrared thermal imaging. The method comprises the steps: acquiring an infrared thermal image through an infrared thermal imager; performing processing classification and instance segmentation on the image through a deep neural network; obtaining pixel coordinates of the ROI by using examples such as a minimum external matrix and an image moment; calibrating a matrix transformation relation from an image coordinate system to a camera coordinate system by using a visual calibration algorithm; performing normal distance measurement through distance measuring equipment; determining the category of the object in the image and the three-dimensional coordinates of the ROI; and transmitting data to an uppercomputer in a distributed node mode. According to the invention, the influence caused by environmental uncertainty is reduced, and stable and uniform light supplementing equipment does not need to beindependently installed. In addition, three-dimensional positioning is conducted on the object in the mode that the ultrasonic sensor and the depth camera are combined, and the positioning accuracy and stability are improved. And a reliable technical method is provided for rapid, accurate and robust visual identification and positioning.

Description

technical field [0001] The invention relates to the technical field of visual recognition, in particular to a visual semantics and position perception method and system based on infrared thermal imaging. Background technique [0002] Due to the development of artificial intelligence, visual recognition technology is more and more widely used in various fields. Visual recognition is to extract, process and understand the image information of objective objects, and finally use it for actual detection and control. [0003] The existing technical solution is to collect RGB images and classify them with OpenCV traditional examples or neural networks to identify related objects. For the category of visual semantic recognition, perform three-dimensional positioning. At present, 3D depth cameras are used to locate objects. The problem with this positioning method is that the point cloud images are not dense enough, and mirror objects are prone to reflection, making the positioning...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/73G06N3/04G06N3/08G06K9/62G06K9/34
CPCG06T7/74G06N3/08G06T2207/10048G06V10/267G06N3/045G06F18/24
Inventor 刘辛军叶彦雷谢福贵于超刘建辉宫昭姜淞文李鹏刘魁吕春哲
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products