Urban area people flow real-time monitoring and calculating method

A real-time computing and real-time monitoring technology, applied in the computer field, can solve problems such as inaccurate business service results, incomplete and continuous delay of data, etc., and achieve the effect of highly flexible streaming time window, high throughput, and high promotion value

Pending Publication Date: 2021-04-23
西安九索数据技术有限公司
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Because the business that needs real-time or quasi-real-time push, such as management and control, depends on the quality of data push, and due to the incomplete continuity of data itself and the delay of front-end processing, it is necessary to design methods to make up for the inaccurate business service results caused by incomplete data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Urban area people flow real-time monitoring and calculating method
  • Urban area people flow real-time monitoring and calculating method
  • Urban area people flow real-time monitoring and calculating method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0114] figure 1 Based on hadoop 2.6.0+spark 1.6.0+Flume 1.2.0+Spark Streaming+Kafka environment, the production and consumption process is constructed.

[0115] 1) On the production side, through the data push of Spark streaming real-time stream, the window is opened under the condition of five minutes as the minimum time granularity; five minutes of real-time data can be received, the data is cleaned, and the time is set according to the minimum time granularity Grouping at intervals and judging the quality of each group of data at the same time, will meet the threshold condition of 80% data transfer to the consumer for consumption;

[0116] 2) Buffer pool module: For the data that does not meet 80% of the threshold condition, store it in the partition table partitioned by time granularity in hive. Merge the data in the partition table when the next real-time stream is connected, and jointly judge whether the data quality meets the threshold. If the threshold condition is s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an urban area people flow real-time monitoring and calculating method. Obtained boundary information of any area of a city is divided into a production end, a consumption end and a task additional recording end; the production end mainly achieves a time-space information data real-time access function, completes data cleaning, judges data quality and generates scheduling for high-quality data in real time, extracts features from the low-quality data to generate an intermediate table, and stores the intermediate table in a data cache pool; the consumption end is used for reading cache pool data, judging data quality, generating a schedule for high-quality data in real time, and carrying out task scheduling according to each task state, execution sequence and restart frequency marked by the schedule, and the task scheduling mainly comprises a calculation task and a prediction task; the task additional recording end is send for reading off-line data, judging data quality, and calculating a regional people flow condition. The method solves the problem of real-time calculation of ten-million-level moving objects based on space-time big data, has the advantages of highly flexible streaming time window, high throughput and the like, is more accurate in calculation result, and supports offline additional recording results.

Description

technical field [0001] The invention belongs to the field of computer technology, and relates to the calculation of using big data technology to monitor the flow of people in urban areas, in particular to a method for real-time monitoring and calculation of the flow of people in urban areas. Background technique [0002] Big data technology has brought about fundamental changes in data and information processing methods, and urban management should move towards a "smart governance" model. It emphasizes the extensive application of knowledge and technology represented by big data, and provides a solution for the country and the government to deal with urban management affairs. Provide data support in real time to improve the predictive power of transaction processing, the power of control during the event, and the power of post-event monitoring. In public places with high concentration of urban crowds, such as scenic spots, shopping malls, gymnasiums, conference venues, etc.,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/215G06F9/48G06F16/9535G06N3/04G06N3/08
CPCG06F16/215G06F16/9535G06F9/4806G06N3/049G06N3/08G06N3/044
Inventor 程鹏飞何芳徐承会刘明张翔刘敏
Owner 西安九索数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products