Pervasive: Object-Based Activity Recognition with Heterogeneous Sensors on Wrist
Object-Based Activity Recognition with Heterogeneous Sensors on Wrist
Takuya Maekawa, Yutaka Yanagisawa, Yasue Kishino, Katsuhiko Ishiguro, Koji Kamei, Yasushi Sakurai and Takeshi Okadome
This paper describes how we recognize activities of daily living (ADLs) with our designed sensor device, which is equipped with heterogeneous sensors such as a camera, a microphone, and an accelerometer and attached to a user’s wrist. Specifically, capturing a space around the user’s hand by employing the camera on the wrist mounted device enables us to recognize ADLs that involve the manual use of objects such as making tea or coffee and watering plant. Existing wearable sensor devices equipped only with a microphone and an accelerometer cannot recognize these ADLs without object embedded sensors. We also propose an ADL recognition method that takes privacy issues into account because the camera and microphone can capture aspects of a user’s private life. We confirmed experimentally that the incorporation of a camera could significantly improve the accuracy of ADL recognition.
Address: Department of Computer Science, P.O. 68 (Gustaf Hällströmin katu 2b), FI-00014 UNIVERSITY OF HELSINKI, FINLAND Opening Hours: During spring and autumn semesters Mon - Fri 7.45 - 19.45 (7.45 am - 7.45 pm) Phone: +358 9 1911 (University switch) General e-mail: info [at] cs.helsinki.fi Fax: +358 9 1915 1120