Research Article
Multimodal Information Processing Method of College English Course Online Education System
@INPROCEEDINGS{10.1007/978-3-031-21161-4_29, author={Baoling Feng and Linan Wang}, title={Multimodal Information Processing Method of College English Course Online Education System}, proceedings={e-Learning, e-Education, and Online Training. 8th EAI International Conference, eLEOT 2022, Harbin, China, July 9--10, 2022, Proceedings, Part I}, proceedings_a={ELEOT}, year={2023}, month={3}, keywords={College English courses Online education system Multimodal information processing Structured processing}, doi={10.1007/978-3-031-21161-4_29} }- Baoling Feng
Linan Wang
Year: 2023
Multimodal Information Processing Method of College English Course Online Education System
ELEOT
Springer
DOI: 10.1007/978-3-031-21161-4_29
Abstract
In order to process the information in the online education system more efficiently, this study designs a multi-modal information processing method for the online education system of college English courses. This study mainly deals with video information, image text information and audio information in the system. Firstly, based on structured processing, the video data stream is divided into organic whole with certain logical structure, and the visual feature information and visual invariant feature are extracted. The multi-branch convolutional neural network is designed and the text features are extracted. Convolutional neural network is used to extract audio features from the system. Finally, a functional model of multi-modal information fusion is designed to realize the fusion processing of multi-modal information. Experimental results show that this method has high data fusion efficiency and timeliness.
