Research Article
Knowledge-Driven Dialogue and Visual Perception for Smart Orofacial Rehabilitation
@INPROCEEDINGS{10.1007/978-3-031-34586-9_26, author={Jacobo L\^{o}pez-Fern\^{a}ndez and Luis Unzueta and Meritxell Garcia and Maia Aguirre and Ariane M\^{e}ndez and Arantza del Pozo}, title={Knowledge-Driven Dialogue and Visual Perception for Smart Orofacial Rehabilitation}, proceedings={Pervasive Computing Technologies for Healthcare. 16th EAI International Conference, PervasiveHealth 2022, Thessaloniki, Greece, December 12-14, 2022, Proceedings}, proceedings_a={PERVASIVEHEALTH}, year={2023}, month={6}, keywords={Orofacial Rehabilitation Dialogue Systems Facial Expression Recognition}, doi={10.1007/978-3-031-34586-9_26} }- Jacobo López-Fernández
Luis Unzueta
Meritxell Garcia
Maia Aguirre
Ariane Méndez
Arantza del Pozo
Year: 2023
Knowledge-Driven Dialogue and Visual Perception for Smart Orofacial Rehabilitation
PERVASIVEHEALTH
Springer
DOI: 10.1007/978-3-031-34586-9_26
Abstract
This paper addresses the problem of accomplishing Orofacial Rehabilitation (OR) with the assistance of artificial intelligence. The main challenges involve accurately monitoring and interacting with the trainees, while preserving user experience. We analyse different approaches to solving these challenges and propose a methodology to build smart knowledge-driven OR systems that focus on automated interaction. Our proposal leverages the combination of vision-based micro and macro facial expression recognition and skill-based dialogue systems, which facilitate encapsulating the knowledge of rehabilitation professionals into natural language interactions. Experimental results of spoken keyword spotting and micro and macro facial expression recognition algorithms are provided. The OR expressions image dataset employed in our experiments is also published to support further research in the field.
