Research Article
A Neural Network Algorithm of Learning Rate Adaptive Optimization and Its Application in Emitter Recognition
@INPROCEEDINGS{10.1007/978-3-030-97124-3_29, author={Jihong Jiang and Yan Gou and Wei Zhang and Jian Yang and Jie Gu and Huaizong Shao}, title={A Neural Network Algorithm of Learning Rate Adaptive Optimization and Its Application in Emitter Recognition}, proceedings={Simulation Tools and Techniques. 13th EAI International Conference, SIMUtools 2021, Virtual Event, November 5-6, 2021, Proceedings}, proceedings_a={SIMUTOOLS}, year={2022}, month={3}, keywords={Neural network Learning rate Algorithm optimization Emitter recognition Application}, doi={10.1007/978-3-030-97124-3_29} }- Jihong Jiang
Yan Gou
Wei Zhang
Jian Yang
Jie Gu
Huaizong Shao
Year: 2022
A Neural Network Algorithm of Learning Rate Adaptive Optimization and Its Application in Emitter Recognition
SIMUTOOLS
Springer
DOI: 10.1007/978-3-030-97124-3_29
Abstract
The setting of the learning rate in neural network training is very important. A too low learning rate will reduce the network optimization speed and prolong the training time while a too high learning rate is easy to exceed the optimal value, leading to the difficulty of model convergence. To solve this problem, based on the analysis of two common learning rate strategies, the attenuating learning rate and the adaptive learning rate, combined with the Adam algorithm, this paper proposes an adaptive learning rate algorithm based on the value of the current loss function and the previous one, and verifies the effectiveness of the algorithm by using the actual radiation source signal. The experimental results show that compared with the Adam algorithm, the number of network training iterations is reduced by 45.5% and the recognition accuracy has increased by 3.6%, which effectively improves the learning speed and reduces the training time.
