Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Digital twin intelligent parking method and system based on reinforcement learning

A reinforcement learning and twinning technology, applied in the computer field, can solve problems such as increased scale and complexity, increased difficulty in construction and debugging, etc.

Active Publication Date: 2022-01-11
EAST CHINA NORMAL UNIV
View PDF13 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the improvement of real-time requirements and the increasing difficulty of overall system construction and debugging, the scale and complexity of cyber-physical fusion systems are increasing, which brings great challenges to the design of safe and reliable smart city systems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Digital twin intelligent parking method and system based on reinforcement learning
  • Digital twin intelligent parking method and system based on reinforcement learning
  • Digital twin intelligent parking method and system based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0079] The Unity3D project of this system is built based on the 2018.4.17 version and released in the form of an .exe executable file. Double-click to run the packaged CarPark.exe program to start the Unity3D project. Such as Figure 8 shown. When the CarPark.exe program is started, a setting box pops up such as Figure 9 shown.

[0080] The control algorithm is written in Python language, and will use websocket to establish a connection with the Unity3D program locally, and control the movement of the virtual car through the MADDPG multi-agent reinforcement learning algorithm. Going back to the Unity3D program interface, you can see that the car has been able to automatically park in place with anti-collision under the control of the algorithm, such as Figure 10 shown. After a period of time, all three cars have found vacant parking spaces and successfully parked in the parking spaces, and no collisions occurred during the process. Figure 11shown. Moreover, the car w...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a digital twin smart parking method based on reinforcement learning, which provides an intelligent and easy-to-use system model for the construction of the smart city information-physics fusion Internet of Things. The smart parking system supports real-time control of the automatic parking process of multiple vehicles in actual scenarios, and can effectively avoid collisions, reduce the cost of manual parking time, and reduce the occurrence of safety accidents due to human error. For the smart parking lot projects that are about to be implemented, digital twin prototypes can be used to carry out the tasks of feasibility analysis, algorithm testing, and functional verification; for smart parking projects that have been implemented, digital twin technology can also be used to realize data. Collect and submit, realize the full-cycle management of parking lot data, and provide assistance for the development and utilization of subsequent data resources.

Description

technical field [0001] The invention belongs to the field of computer technology, and in particular relates to a digital twin intelligent parking method and system based on reinforcement learning. Background technique [0002] With the gradual digitalization of human society and the development of artificial intelligence, Internet of Things, cloud computing, 5G and other technologies, the demand for information-physical fusion systems is also increasing at this stage. In the past, a single system implemented simple " It is difficult to meet the needs of the people and the country. Accurate and real-time cognition, control and coordination of macroscopic multi-heterogeneous systems (such as smart city systems covering heterogeneous systems such as smart transportation, smart fire protection, and smart parks) are gradually Become the development direction of information-physical fusion system. The smart city information-physical fusion system is a networked physical equipment...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G08G1/14G06F30/20
CPCG08G1/148H04L67/125H04L67/10G06F30/20H04L41/145
Inventor 陈铭松黄红兵韩定定曹鹗夏珺周亮焦阳
Owner EAST CHINA NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products