Research Article
Simulation Operation System of Civil Aviation Professional Electromechanical Equipment Based on Human-Computer Interaction
@INPROCEEDINGS{10.1007/978-3-031-21161-4_56, author={Dan Zhao and Xin Zhang}, title={Simulation Operation System of Civil Aviation Professional Electromechanical Equipment Based on Human-Computer Interaction}, proceedings={e-Learning, e-Education, and Online Training. 8th EAI International Conference, eLEOT 2022, Harbin, China, July 9--10, 2022, Proceedings, Part I}, proceedings_a={ELEOT}, year={2023}, month={3}, keywords={Civil aviation Simulation practice of electromechanical equipment Human computer interaction Gesture recognition}, doi={10.1007/978-3-031-21161-4_56} }- Dan Zhao
Xin Zhang
Year: 2023
Simulation Operation System of Civil Aviation Professional Electromechanical Equipment Based on Human-Computer Interaction
ELEOT
Springer
DOI: 10.1007/978-3-031-21161-4_56
Abstract
Traditional equipment simulation operating system adopts the principle of combining real object with simulation, which has the problems of poor feedback accuracy and slow operation feedback speed. In view of the above problems, this research designs a civil aviation professional electromechanical equipment simulation and operation system based on human-computer interaction. Taking FPGA and arm as the core, the hardware part of the system is designed by connecting Kinect sensor. After the electromechanical equipment simulation model is established by using 3D Max software, the key frames in the actual operation interactive action video are extracted by using k-means clustering algorithm, and then the simulation operation gestures are recognized by combining with the expert judgment module, so as to realize the electromechanical equipment simulation operation training under human-computer interaction. Experimental results show that the feedback accuracy of the system is higher than 95%, and the feedback is sensitive, interactive and the simulation scene is clearer.
