RI | Research | Projects | Multimodal Diaries

Text only version of this site

Multimodal Diaries Head: Fernando De la Torre Frade Contact: Fernando De la Torre Frade (ftorre@cs.cmu.edu) Mailing address: Carnegie Mellon University Robotics Institute 211 Smith Hall Pittsburgh, PA 15213 Associated center: VASC

Jump to: Project Description | Personnel | Publications

Project Description

In this project, we propose a system that summarizes a user's daily activity (e.g. sleeping, eating, working on a pc) from multimodal data (audio, video, body sensors, ...). The system combines both the physical and contextual awareness of hardware and software to record synchronized audio-visual, body sensing, global position information and computer monitoring data. A key component of our system is a semi-supervised temporal clustering algorithm that efficiently and accurately groups large amounts of multimodal data by activity. The system has a wide variety of applications to time management, self-knowledge and human computer interaction systems in general.

Personnel [Past Members]

	Name	Title	Email Address
	Fernando De la Torre Frade	Research Scientist	ftorre@cs.cmu.edu

Publications

Note: This list may not be comprehensive. It contains only those publications in the RI publications database. Entries are listed in reverse chronological order.

• Multimodal Diaries
  F. De la Torre Frade and C. Agell
  International Conference on Multimedia and Expo, July, 2007. [Abstract]
  Download: pdf [698 KB] copyrighted