A data processing system and method based on big data

A data processing and big data technology, applied in the field of data processing, can solve problems such as low data transmission efficiency and inability to control the data transmission process, and achieve the effect of ensuring data transmission efficiency, improving data transmission speed, and increasing data transmission speed

Active Publication Date: 2022-05-03
北京新赛点体育投资股份有限公司
View PDF13 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] For this reason, the present invention provides a data processing method based on big data to overcome the problem of inability to control the data transmission process in the prior art, resulting in low data transmission efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data processing system and method based on big data
  • A data processing system and method based on big data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] In order to make the objects and advantages of the present invention clearer, the present invention will be further described below in conjunction with the examples; it should be understood that the specific examples described here are only for explaining the present invention, and are not intended to limit the present invention.

[0043] Preferred embodiments of the present invention are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principle of the present invention, and are not intended to limit the protection scope of the present invention.

[0044] It should be noted that, in the description of the present invention, terms such as "upper", "lower", "left", "right", "inner", "outer" and other indicated directions or positional relationships are based on the terms shown in the accompanying drawings. The direction or positional relationship shown is ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention relates to a data processing method based on big data, including: step S101, acquiring the data characteristics of each data to classify the data; step S102, selecting the data transmission channel for sending the data of each type according to the actual quantity of each type of data Quantity; step S103, determine the quantity of the data transmission channel that sends corresponding type of data according to the type of data, and transmit the data of corresponding type; Step S104, obtain the actual transmission speed of each data transmission channel, and according to the actual transmission speed of each data transmission channel Optionally compress the transmitted data. The present invention can effectively reduce the data size by compressing the remaining unsent data, so as to increase the data transmission speed per unit time, further ensure the data transmission efficiency, and effectively improve the data transmission speed.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data processing system and method based on big data. Background technique [0002] Chinese patent publication number: CN107818120B. Disclosed are a data processing method and device based on big data. The above method includes: monitoring and collecting the first data of each data source in real time; transmitting the first data to a distributed message system for storage; reading the first data from the distributed message system, and storing the first data Convert the first data into a preset format to obtain second data; obtain a data processing framework corresponding to the second data, and send the second data to a node matching the data processing framework; through the The node processes the second data, and writes the second data into a data processing framework matching the node. The above data processing method and device based on big data can writ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F21/62H04L69/14H04W4/029
CPCA63B71/0622A63B69/0028A63B24/0062H04W4/029A63B2071/063A63B2071/065A63B2220/20A63B2220/30A63B2220/40A63B2230/06A63B2071/0655
Inventor 徐林洲代志权刘亚丹
Owner 北京新赛点体育投资股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap