Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data warehouse system based on urban brain

A data warehouse and brain technology, applied in the field of data warehouse, can solve the problems of lack of specifications, the database can not meet the storage and processing of big data, etc., to achieve the effect of improving efficiency and reducing file reading and writing io

Inactive Publication Date: 2021-03-19
BEIJING ZHONGHAIJIYUAN DIGITAL TECH DEV CO LTD
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] With the rapid increase of Internet data, people are gradually realizing the importance of data. The application of scientific data processing, business intelligence data analysis, and data analysis requirements for building an integrated city brain is becoming more and more common. Traditional databases can no longer Meet the storage and processing needs of big data
At present, there is no clear specification for the construction of a data warehouse for the Hadoop ecosystem, so this article explores a data warehouse construction method and system for the city brain

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data warehouse system based on urban brain
  • Data warehouse system based on urban brain
  • Data warehouse system based on urban brain

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to demonstrate the technical solution of the present invention clearly and in detail, the present invention will be described below in conjunction with the accompanying drawings, but it is not used to limit the scope of the present invention.

[0031] see figure 1 A city brain-based data warehouse system provided in Embodiment 1 of the present invention includes:

[0032] Hadoop-based distributed storage framework, distributed file system, data ETL, five-tier data warehouse, online OLAP, Hadoop-based distributed computing engine and metadata; wherein, the distributed storage framework is used to store massive external data source; the distributed file system is used to store the data source in the form of a file; the five-layer data warehouse is used to count and store the data source; the online analysis process is used to Respond to most analysis requirements within a set time period; Hadoop's distributed computing engine is used to calculate data sources th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a data warehouse system based on an urban brain. The data warehouse system based on the urban brain comprises a distributed file system based on Hadoop, a dataETL, a five-layer data warehouse, online analysis processing, a distributed computing engine based on Hadoop and metadata. According to the method, a Hadoop-based distributed file system and a computing engine are adopted to construct a distributed data warehouse system, and storage, unified processing and analysis are performed on multivariate heterogeneous data; the data warehouse is reasonablylayered, the reuse rate of the data is improved, it is basically guaranteed that the data of the layer in the data warehouse depends on the data of the upper layer to be obtained, and repeated workloads caused by new requirements every time are avoided.

Description

technical field [0001] The invention relates to the technical field of data warehouses, in particular to a method and system for constructing data warehouses based on the city brain. Background technique [0002] The city brain is based on the data resources generated by the city, using artificial intelligence, big data, blockchain, 5G, Internet of Things and other new generation information technologies to provide services for urban traffic management, public safety, emergency management, urban sanitation, tourism, and environmental protection. An artificial intelligence center constructed by , urban refined management, etc., promotes the construction and opens up various urban digital management platforms, uses real-time and full amount of urban data, timely corrects operational shortcomings, optimizes urban public resources, and realizes urban governance models, service models and A high-quality breakthrough in the development of the digital industry. [0003] Data wareh...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/25G06F16/28
CPCG06F16/254G06F16/283
Inventor 梁鹏飞李晓东崔师龙王崟乐
Owner BEIJING ZHONGHAIJIYUAN DIGITAL TECH DEV CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com