Data processing method, device and equipment and computer readable storage medium

Abstract

The embodiment of the invention provides a data processing method and device, equipment and a computer readable storage medium. According to the method provided by the embodiment of the invention, the empirical data of model training can be stored in a structured form by pre-creating and maintaining the meta-knowledge resource library consisting of the data meta-features of the data set and the meta-knowledge of the model meta-features generated when the data set is used for model training; further, during model training, model hyper-parameter initialization is performed according to the meta-knowledge resource library; according to the meta-knowledge resource library and the pre-configured early stop control strategy, the training process of the invalid hyper-parameter combination is stopped in advance, model training can be guided according to empirical data of model training without depending on knowledge and experience of a certain person, the training process without hyper-parameter combination can be reduced, the time consumption of model training is shortened, the model training efficiency is improved, and hardware resources and labor cost of model training can be reduced.

Description

technical field [0001] The embodiments of the present invention relate to the field of computer technology, and in particular, to a data processing method, device, device, and computer-readable storage medium. Background technique [0002] When human beings learn new knowledge and skills, they often use existing knowledge and experience as the basis and learn from methods and methods summarized on related tasks, rather than learning from scratch. With the accumulation of knowledge and experience, it will become easier to learn new knowledge and skills, and it can also reduce the cost of trial and error. In the field of machine learning and deep learning, designing and training a high-accuracy and robust algorithm model that solves practical problems in production applications often requires a lot of hyperparameter setting and tuning, including the selection of specific basic algorithm models and the settings of the corresponding hyperparameters. [0003] In order to train ...

AI Technical Summary

Problems solved by technology

[0006] Embodiments of the present invention provide a data processing method, device, equipment, and computer-readable storage medium. The methods used to solve the problem in the prior art rely heavily on personal knowledge and experience, and repeated rounds of debugging consume a lot of hardware resources and labor costs. The problem that the model training takes a long time and the efficiency is very low

Images