sis 15(6): e4

Research Article

Perceptually-Inspired Computing

Download954 downloads
  • @ARTICLE{10.4108/icst.intetain.2015.260201,
        author={Ming Lin},
        title={Perceptually-Inspired Computing},
        journal={EAI Endorsed Transactions on Scalable Information Systems},
        keywords={perceptually-inspired computing, human perceptual systems, crowd simulation, multimodal interaction, human-computer interaction, entertainment, video games, computer animation},
  • Ming Lin
    Year: 2015
    Perceptually-Inspired Computing
    DOI: 10.4108/icst.intetain.2015.260201
Ming Lin1,*
  • 1: Department of Computer Science - University of North Carolina at Chapel Hill
*Contact email:


Human sensory systems allow individuals to see, hear, touch, and interact with the surrounding physical environment. Understanding human perception and its limit enables us to better exploit the psychophysics of human perceptual systems to design more efficient, adaptive algorithms and develop perceptually-inspired computational models. In this talk, I will survey some of recent efforts on perceptually-inspired computing with applications to crowd simulation and multimodal interaction. In particular, I will present data-driven personality modeling based on the results of user studies, example-guided physics-based sound synthesis using auditory perception, as well as perceptually-inspired simplification for multimodal interaction. These perceptually guided principles can be used to accelerating multi-modal interaction and visual computing, thereby creating more natural human-computer interaction and providing more immersive experiences. I will also present their use in interactive applications for entertainment, such as video games, computer animation, and shared social experience. I will conclude by discussing possible future research directions.