Research Article
Fusion of Sound Source Localization and Face Detection for Supporting Human Behavior Analysis
@INPROCEEDINGS{10.4108/ICST.MOBIMEDIA2008.4071, author={ Markus Niiranen and Janne Vehkaper\aa{} and Satu-Marja M\aa{}kel\aa{} and Johannes Peltola and Tomi R\aa{}ty}, title={Fusion of Sound Source Localization and Face Detection for Supporting Human Behavior Analysis}, proceedings={4th International ICST Mobile Multimedia Communications Conference}, publisher={ICST}, proceedings_a={MOBIMEDIA}, year={2010}, month={5}, keywords={Audio localization audio detection microphone arrays face detection}, doi={10.4108/ICST.MOBIMEDIA2008.4071} }- Markus Niiranen
Janne Vehkaperä
Satu-Marja Mäkelä
Johannes Peltola
Tomi Räty
Year: 2010
Fusion of Sound Source Localization and Face Detection for Supporting Human Behavior Analysis
MOBIMEDIA
ICST
DOI: 10.4108/ICST.MOBIMEDIA2008.4071
Abstract
This paper describes a demonstrated concept implementation that combines sound source localization and face detection from video stream for supporting human behavior analysis. System monitors space containing multiple persons using microphone array and video camera. The aim is to detect which person in the scene is producing the sound that is received by the microphones. For this task the microphone array localizes the sound in the environment. Simultaneously face detection is performed to the video signal produced by the monitoring video camera. If face is detected from the bearing of the sound the system may decide that the sound is produced by the person who's face is detected. Preliminary results indicate that the fusion may give useful information for human behavior analysis for space containing multiple persons.