Intelligent platform labeling method and device, electronic equipment and storage medium

Abstract

The invention relates to an intelligent platform labeling method and device, electronic equipment and a storage medium, and the method comprises the steps: in a learning stage, a labeling platform receives to-be-labeled data uploaded by an engineer; an administrator divides the to-be-labeled data into first learning data and first to-be-labeled data on the labeling platform; a labeling expert labels the first learning data on a labeling platform to obtain gold standard data; a labeling person labels the first learning data on a labeling platform to obtain first labeling data; the labeling platform performs comparison and scoring on the gold standard data and the first labeling data; and whether the labeling person has the capability of labeling other to-be-labeled data is determined according to the scoring result. According to the method of the invention, the learning stage is added, the annotation difference between the annotation personnel and the annotation specialist is evaluated, and the annotation level difference between the annotation personnel and the annotation specialist is judged, so that the situation of data back-annotation caused by insufficient annotation level of the annotation personnel is reduced, and the annotation efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of intelligent labeling, in particular to a method, device, electronic equipment and storage medium of an intelligent labeling platform. Background technique [0002] At present, in the field of data labeling, there is a lack of data selection process. Some data have limited effect on model improvement, but it is possible to label this part of the data, which will increase the cost of labeling; there is a lack of a stage to evaluate the labeling level of labelers. Contents of the invention [0003] The present invention provides a method, device, electronic equipment, and storage medium of an intelligent labeling platform, which can solve the above-mentioned technical problems of increasing labeling costs and lack of labeling level evaluation for labeling personnel. [0004] The technical scheme that the present invention solves the problems of the technologies described above is as follows: [0005] In a...

AI Technical Summary

Problems solved by technology

[0002] At present, in the field of data labeling, there is a lack of data selection process, and some data have limited effect on model improvement, but it is possible to label this part of the data, which will increase the cost of labeling; there is a lack of a stage to evaluate the labeling level of labelers

Images