Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Batch data processing method and device thereof, computer equipment and storage medium

A technology of data processing and batch data, applied in the direction of electrical digital data processing, calculation, multi-program device, etc., can solve the problem of low batch data processing speed, improve batch data processing efficiency, ensure data acquisition speed and data processing speed effect

Pending Publication Date: 2021-10-15
PINGAN PUHUI ENTERPRISE MANAGEMENT CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the embodiment of the present application is to propose a batch data processing method, device, computer equipment and storage medium to solve the problem of low batch data processing speed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Batch data processing method and device thereof, computer equipment and storage medium
  • Batch data processing method and device thereof, computer equipment and storage medium
  • Batch data processing method and device thereof, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field of the application; the terms used herein in the description of the application are only to describe specific embodiments The purpose is not to limit the present application; the terms "comprising" and "having" and any variations thereof in the specification and claims of the present application and the description of the above drawings are intended to cover non-exclusive inclusion. The terms "first", "second" and the like in the description and claims of the present application or the above drawings are used to distinguish different objects, rather than to describe a specific order.

[0039] Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The occurrenc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of cloud, and relates to a batch data processing method and a device thereof, computer equipment and a storage medium, and the method comprises the steps: when a data processing instruction is received, calculating a data processing index of each node according to a data processing factor of each node in a cluster; calculating a data processing fluctuation index of the cluster based on the data processing index; when the data processing fluctuation index is greater than a preset fluctuation index threshold value, acquiring a transmission evaluation factor of each node; calculating the data distribution proportion of each node according to the data processing factor and the transmission evaluation factor; dividing the to-be-processed batch data according to the data distribution proportion to obtain a plurality of groups of to-be-distributed data; and indicating the node to obtain the to-be-distributed data according to the data distribution proportion, and indicating the node to perform data processing on the to-be-distributed data to obtain processed data. In addition, the invention also relates to a block chain technology, and the data processing factor and the transmission evaluation factor can be stored in a block chain. The batch data processing efficiency is improved.

Description

technical field [0001] The present application relates to the field of cloud technology, and in particular to a batch data processing method, device, computer equipment and storage medium. Background technique [0002] With the development of computer technology, more and more business systems use cloud technology to process batch data. The processing of batch data can be realized through timed tasks, usually a server in the cluster is designated by the distributed scheduling system to execute processing tasks at a certain point in time. However, this traditional batch data processing technology will lead to idle waste of cluster resources and reduce the processing speed of batch data in business systems. The system crashes, affecting the batch data processing speed. Contents of the invention [0003] The purpose of the embodiment of the present application is to provide a batch data processing method, device, computer equipment and storage medium to solve the problem of...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/50
CPCG06F9/5061
Inventor 林继丰
Owner PINGAN PUHUI ENTERPRISE MANAGEMENT CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com