A Group Lasso-Based Neural Network Pruning Method for Power Amplifiers

A power amplifier and neural network technology, applied in the field of communication, can solve problems such as weak robustness, easy overfitting, difficult hardware resource overhead, etc., to improve fitting performance and accuracy, suppress overfitting, and improve pre-distortion effect of effect

Active Publication Date: 2021-06-08
BEIJING UNIV OF POSTS & TELECOMM +1
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] In order to overcome the disadvantages of the neural network in the prior art, such as difficulty in manual debugging, easy overfitting, weak robustness, difficulty in engineering implementation, and large hardware resource overhead, the present invention provides a neural network based on Group Lasso for power amplifiers The clipping method can clip or directly train the neural network structure of the real multi-layer neural network, thereby suppressing overfitting and easy engineering implementation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Group Lasso-Based Neural Network Pruning Method for Power Amplifiers
  • A Group Lasso-Based Neural Network Pruning Method for Power Amplifiers
  • A Group Lasso-Based Neural Network Pruning Method for Power Amplifiers

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0091] Example: such as Figure 5 As shown, the real and imaginary parts of the input signal are x r (n) and x i (n), the input signal and its delay signal are used as the input of the neural network, and the real and imaginary parts of the current output signal are respectively y r (n) and y i (n) as the reference output of the neural network ( Figure 5 Just to illustrate the application of the present invention in a certain network, for different multi-layer real number networks with different input and output forms and different structures, this algorithm can still be used to simplify the network structure, because this algorithm uses the weight of the network Make a constraint and implement training through BP, regardless of the input and output types of the network), divide the weights connected to the same neuron into a group, and use the idea of ​​​​Group Lasso to record the weight group as w, such as Figure 6 shown, and then rewrite the loss function as, The tr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a Group Lasso-based neural network clipping method for a power amplifier, which belongs to the technical field of communication. First, for the original neural network structure, all the output weights connected to the same neuron in the other layers except the output layer are grouped into one group; after grouping, L is performed on each group of weights separately. 2 norm constraint; then L of the weights of all groups in the original neural network structure 2 The sum of the norms is added to the original loss function Loss as a Group Lasso penalty 1 After that, get a new loss function Loss 2 ; Through the BP algorithm to Loss 2 Minimize the training, find the weight groups whose convergence is close to 0, and remove the neurons connected by these weight groups to obtain a simplified neural network, and use the BP algorithm to analyze the original loss function Loss 1 Perform training to obtain a simplified neural network model after training, and use the model to model or predistort the power amplifier. The invention can suppress the overfitting in the training process, improve the pre-distortion effect, reduce the amount of calculation, and is convenient for engineering application.

Description

technical field [0001] The invention belongs to the technical field of communication, in particular to a Group Lasso-based neural network cutting method for power amplifiers. Background technique [0002] With the continuous development of communication technology, in order to use limited spectrum resources more efficiently, new modulation techniques with high spectrum efficiency are used in communication standards. However, these new modulation methods make the peak-to-average ratio of the signal higher and the envelope fluctuation larger, causing the signal to be seriously distorted after passing through the RF power amplifier; not only the EVM before and after the signal output is seriously deteriorated, but also serious out-of-band distortion . [0003] In order to correct the distortion produced by the signal passing through the power amplifier, the power amplifier needs to be linearized. Among the current linearization technologies, the predistortion technology is wi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/62G06N3/08
CPCG06N3/084G06F18/214
Inventor 于翠屏唐珂刘元安黎淑兰苏明吴永乐王卫民唐碧华
Owner BEIJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products