Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Unstructured data processing method and device

An unstructured data, unstructured technology, applied in structured data retrieval, electronic digital data processing, special data processing applications, etc., can solve problems such as poor compatibility and flexibility, and achieve the effect of improving efficiency and effectiveness

Active Publication Date: 2018-06-29
CHINA MOBILE GROUP SHAIHAI +1
View PDF3 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the defect that existing data processing methods have poor compatibility and flexibility when extracting different types of data sources, the present invention proposes the following technical solutions:

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unstructured data processing method and device
  • Unstructured data processing method and device
  • Unstructured data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are the Some, but not all, embodiments are invented. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0038] figure 1 It is a schematic flow diagram of an unstructured data processing method according to an embodiment of the present invention, such as figure 1 As shown, the method includes:

[0039] S1: Process the obtained unstructured data to obtain data in the target format;

[0040] Specifically, the processor processes the acquired unstructured data, that is, pe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an unstructured data processing method and device. The method comprises the steps that obtained unstructured data is processed to obtain data in a target format; the content of the data in the target format is recognized to convert the data in the target format into structured data according to a recognition result; a corresponding index is generated for the structured data by calling an index generation tool of a preset server. According to the unstructured data processing method and device, a plurality of complicated unstructured data sources can be accessed in a unified mode, a processing method for data entities in the non-structural data sources is enhanced, the effectiveness and efficiency of data reading are guaranteed, hot-pluggable data processing is achieved, and the flexibility of system configuration is improved; by providing a fault-tolerant mechanism, the efficiency and effectiveness guarantee is provided for processing of large-scale unstructureddata sources.

Description

technical field [0001] The invention relates to the technical field of data services, in particular to a method and device for processing unstructured data. Background technique [0002] At present, data processing methods mainly include application programming interface API, data warehouse technology ETL, DB data interface and message queue (MQ). Specifically, API is to develop interface programs between applications, use communication protocols (such as SOAP, HTTP, etc.) to extract original data according to business logic, and write them into the target database; ETL is to use existing and mature tools to Establish a data channel between the data source and the data target, and import the data from the source database to the target database through the data engine; the DB interface is between relational databases, configure the database connection, read the original data according to the database table entry, and then The result is inserted into the target database; the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/22G06F16/258G06F16/3331
Inventor 陈毅
Owner CHINA MOBILE GROUP SHAIHAI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products