We present a complete multi-modal perception driven non-intrusive domestic robotic system for the elderly.
We present a novel multi-modal user’s intention-for-interaction detection modality.
A fusion method to improve the speech recognition given the user’s position, available sensors, and recognition tools is presented.
We present details of the complete implemented system along with relevant evaluations that demonstrate the soundness of the framework via an exemplar application whereby the robot helps the user find hidden or misplaced objects in his/her living place.
The proposed framework is further investigated by conducting relevant user studies involving 17 elderly participants.