RI | Publications | Multimodal Diaries

Text only version of this site

Multimodal Diaries
F. De la Torre Frade and C. Agell
International Conference on Multimedia and Expo, July, 2007.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Download [Help]

Adobe portable document format (pdf) [698 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Time management is an important aspect of a successful professional life. In order to have a better understanding of where our time goes, we propose a system that summarizes the user's daily activity (e.g. sleeping, walking, working on the pc, talking, ...) using all-day multimodal data recordings. Two main novelties are proposed: 1) A system that combines both physical and contextual awareness hardware and software. It records synchronized audio, video, body sensors, GPS and computer monitoring data. 2) A semi-supervised temporal clustering (SSTC) algorithm that accurately and efficiently groups huge amounts of multimodal data into different activities.

The effectiveness and accuracy of our SSTC is demonstrated in synthetic and real examples of activity segmentation from multimodal data gathered over long periods of time.

Notes

Associated center: VASC
Associated project: Multimodal Diaries

Note: associated project multimodal diaries

Text Reference

F. De la Torre Frade and C. Agell, "Multimodal Diaries," International Conference on Multimedia and Expo, July, 2007.

BibTeX Reference

@inproceedings{De la Torre Frade_2007_5734,
   author = "Fernando De la Torre Frade and Carlos Agell",
   title = "Multimodal Diaries",
   booktitle = "International Conference on Multimedia and Expo",
   month = "July",
   year = "2007",
   note = "associated project multimodal diaries"
}