Translation model compression method, translation method and related device

Abstract

One or more embodiments of the present specification disclose a translation model compression method, a translation method and a related device, the method comprising: extracting a word list vector set from a target translation model, determining a quantization interval based on a normal distribution result mapped by the word list vector set, calculating the number of interval segments to be divided according to the determined quantization precision, dividing the quantization interval into a plurality of quantization interval sections with the same number as the interval sections according to an equal division mode, distributing a unique interval number for each quantization interval section, and respectively dividing high-bit original values corresponding to elements of word list vectors contained in each quantization interval section into a plurality of quantization interval sections, and replacing with a high-bit interval number of the corresponding quantization interval section, and writing a word list vector represented by the interval number into the target translation model. Therefore, compression of the target translation model is realized.

Description

technical field [0001] This document relates to the technical field of artificial intelligence, in particular to a translation model compression method, translation method and related apparatus. Background technique [0002] With the continuous development of machine translation technology, online translation has been widely used. At the same time, with the upgrade of business, there are more and more application scenarios for offline translation. Terminal devices such as scanning pens, translators, and simultaneous interpretation headsets usually use translation functions in no or weak network environments. . [0003] However, the memory resources of such terminal equipment are generally limited, and the memory on the terminal equipment is usually shared by the system module, translation module, optical character recognition module, human-machine dialogue module, etc., and the memory occupies a large amount. [0004] At present, many compression schemes for translation mo...

AI Technical Summary

Problems solved by technology

[0003] However, the memory resources of this type of terminal equipment are generally limited, and the memory on the terminal equipment is usually shared by the system module, translation module, optical character recognition module, man-machine dialogue module, etc., and the memory usage is large

[0004] At present, many compression schemes for translation models have been proposed in the industry. However, due to unreasonable compression methods, although memory usage can be reduced, it is also easy to cause a large loss in translation quality.

Images