Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Missing Object Search Method Based on Reinforcement Learning Algorithm

A technology of reinforcement learning and target search, applied in machine learning, computing, computing models, etc., to reduce the search cost

Active Publication Date: 2022-08-05
FUZHOU UNIV
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This presents a huge challenge for finding the target

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Missing Object Search Method Based on Reinforcement Learning Algorithm
  • A Missing Object Search Method Based on Reinforcement Learning Algorithm
  • A Missing Object Search Method Based on Reinforcement Learning Algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] In order to make the features and advantages of this patent more obvious and easy to understand, the following specific examples are given and described in detail as follows:

[0060] like image 3 As shown, taking the vehicle as the target as an example, the method for selecting a search time position at a search time based on a reinforcement learning algorithm provided by the embodiment of the present invention mainly includes the following steps:

[0061] Step S1, data preprocessing: this step includes the discretization of time and space; the discretization of the target movement trajectory; the scalarization of search difficulty in different time and space, that is, the search cost: Step S11, connect and read the original database to obtain the target According to the GPS coordinate information, the complete trajectory data of the target day is extracted according to the ID mark; step S12, the time of one day is discretized at a fixed time interval ΔT, and the area...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a missing target search method based on a reinforcement learning algorithm, which includes the following steps: Step S1, data preprocessing: including time and space discretization; Step S2, building a reinforcement learning training environment: building a reinforcement learning training environment, the training environment information includes the expected search cost of objects starting from different locations at different times at different search moments and the probability of transferring to different locations at different search moments; Step S3, Offline training of the spatiotemporal search model: self-adaptive optimization of the state and behavior definitions and models; step S4, online spatiotemporal search decision: based on the spatiotemporal search model trained in step S3, iteratively adopts a greedy strategy to determine the spatiotemporal search sequence and execute the spatiotemporal search . It effectively reduces the search cost of finding the location of the target at the target moment, and completes the target search task under the search cost constraint.

Description

technical field [0001] The invention belongs to the field of missing target searching under the constraint of crowd intelligence perception cost, and in particular relates to a missing target searching method based on a reinforcement learning algorithm. Background technique [0002] Finding missing objects (for example, cars or people) in cities is critical to city safety management. For example, a suspicious car was identified at a certain point in the past. Instructions attached figure 1 Typical application scenarios are shown. The serial numbers represent the waypoints of the vehicle's trajectory from 8:00 to 9:00 on a certain day, including the location of certain key moments (light color). By determining the location of the suspicious vehicle at a specific moment (ie, the target moment) and marking it on the map, and so on, until its approximate trajectory can be grasped. Shortly after this, the police seized the clue and intend to monitor the suspicious vehicle's w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/9537G06N20/00G01S19/19
CPCG06F16/9537G06N20/00G01S19/19
Inventor 於志勇韩磊黄昉菀郭文忠
Owner FUZHOU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products