Research Article
Training Simulation System of Aviation Electromechanical Specialty Based on Multimodal Information Processing
@INPROCEEDINGS{10.1007/978-3-031-21161-4_31, author={Xin Zhang and Dan Zhao}, title={Training Simulation System of Aviation Electromechanical Specialty Based on Multimodal Information Processing}, proceedings={e-Learning, e-Education, and Online Training. 8th EAI International Conference, eLEOT 2022, Harbin, China, July 9--10, 2022, Proceedings, Part I}, proceedings_a={ELEOT}, year={2023}, month={3}, keywords={Aviation electromechanical specialty Simulation training Professional training Multimodal information Information processing Simulation system Target perception}, doi={10.1007/978-3-031-21161-4_31} }- Xin Zhang
Dan Zhao
Year: 2023
Training Simulation System of Aviation Electromechanical Specialty Based on Multimodal Information Processing
ELEOT
Springer
DOI: 10.1007/978-3-031-21161-4_31
Abstract
Traditional training simulation system has the problems of low recognition accuracy and long response time because of its poor perception effect on learning dynamic target. Therefore, this study designed a practical training simulation system based on multi-modal information processing for aviation electromechanical specialty. In the hardware part, the RS422 interface circuit is used to transmit the working state of the board, and the loopback clock circuit is used to transmit the signals of the multi-board. In the software part, after the component model library of the training simulation system is established, the learning object perception model is established through multi-modal information processing, and the multi-modal teaching information is integrated. Finally, a professional training simulation teaching module is designed to meet the various needs of training teaching. In the experiment, the system presented in this paper is compared with two traditional systems, and it is found that the system presented in this paper can effectively improve the recognition accuracy of gesture rules and speech keywords, and effectively shorten the time for the system to process user requests.
