Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Unstructured data and fragmented data aggregation system

A technology of unstructured data and data aggregation, applied in the direction of electrical digital data processing, special data processing applications, inter-program communication, etc., can solve the problems of reduced aggregation efficiency, long bandwidth occupation time, insufficient processing capacity, etc. Performance, simple merge strategy, and increased flexibility

Inactive Publication Date: 2017-10-13
NANJING LES INFORMATION TECH
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

With more and more video transmission lines, even a relatively powerful processor will have insufficient processing power
[0003] At present, unstructured data is transmitted in a compressed manner. Unstructured data such as audio and video compression rate is not high, and the bandwidth time is relatively long during the data transmission process. With more and more collection points, the efficiency of concurrent aggregation will decrease, which will inevitably lead to partial collection. The failure rate of point data upload increases, and the data cannot be aggregated in a timely, accurate and effective manner

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unstructured data and fragmented data aggregation system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] Explanation of terms used in the present invention includes the following parts:

[0022] Unstructured data fragmentation technology: Distributed coding technology is adopted to physically slice unstructured data first, and then fragmentize each file. Each piece of unstructured data uses a different encryption algorithm, and the same unstructured data The fragmented data can be encrypted using multiple encryption algorithms at the same time.

[0023] Data Aggregation: Combining data from different data sources.

[0024] MD5: Message Digest Algorithm MD5 (Chinese name is the fifth edition of Message Digest Algorithm) is a hash function widely used in the field of computer security to provide message integrity protection.

[0025] Hash: Hash, also directly transliterated as "hash", is to convert an input of any length (also called pre-mapping, pre-image) into a fixed-length output through a hash algorithm, and the output is the hash value . This conversion is a compres...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an unstructured data and fragmented data aggregation system. Message queue service, a memory library, a file type database and daemon process and various technologies are used, and the system can efficiently process and merge mass fragmented data of unstructured data (for example, audio and video data). A strict encryption and decoding strategy is used, and the system ensures safety and correctness of merging.

Description

technical field [0001] The invention relates to the field of computer data processing, in particular to a collection system for unstructured data and fragmented data. Background technique [0002] Safe City is the largest system with the most complex business. The scale of video access in the security field ranges from thousands to hundreds of thousands. The size of data is growing at an alarming rate. For a large amount of video data, distributed storage and centralized storage coexist in practical applications. Video retrieval personnel cannot work in a distributed manner and require centralized work, so the distributed video data must be aggregated. Integrate a variety of public security internal and social image information resources into the image resource library, and sort out, classify and store audio, video, and image information concerned by various departments and police types. At the same time, establish index summaries to facilitate evidence search and case corr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/54G06F17/30
CPCG06F9/546G06F2209/541G06F16/1724
Inventor 庄青
Owner NANJING LES INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products