The Robotics Institute
 Search the site
RI | Research | Projects | 3D Video Reconstruction of Skeletal Anatomy

Text only version of this site

[Project image] 3D Video Reconstruction of Skeletal Anatomy
This project is no longer active.

Head: Takeo Kanade
Contact: Kong Man Cheung

Mailing address:
MRT Center
The Robotics Institute
Carnegie Mellon University
5000 Forbes Avenue
Pittsburgh PA 15213-3890
(412) 268 6553 (Jim Osborn, Executive Director)
(412) 268 6436 (FAX)

Associated center: MRTC

For more information, see this project's homepage.

Jump to: Project Description | Personnel

Project Description

Objective

The objective of this project is to reconstruct the 3D shape of the skeleton of mouse fetuses for pharmaceutical research. The major difficulty of this project is that the fetal skeletons are stored in glass bottles filled with glycerol which causes distortion/refraction in the camera images.

Method

Since light travels in straight lines in a homogeneous medium, we can experimentally calibrate the distortion/refraction of the images caused by the glycerol and glass bottle by putting a simple calibration grid on a glass bottle filled with glycerol (but without the actual fetus bones). The grid is first imaged with it facing the camera and then imaged again with a 180 degrees rotation (so that the grid is imaged with the bottle of glycerol in between the camera and the grid to capture the distortion). Once these images are captured, the grids positions are extracted and we can estimate the directions of the light inside the bottles. Once this is known, the fetus are imaged on a rotation table and Shape-From-Silhouette is used to reconstruct the shapes of the bones.

Results

Some of the input images The calibration grid images The reconstructed 3D model
(from different viewpoints)
Video   Video

Past members

Name Title Email Address
Kong's personal homepage Kong Man Cheung Postdoctoral Fellow
Takeo's personal homepage Takeo Kanade U.A. and Helen Whitaker University Prof., RI/CS tk@cs.cmu.edu

The Robotics Institute is part of the School of Computer Science, Carnegie Mellon University.
For updates and comments, please see these instructions.
This page maintained by robotwebmaster@ri.cmu.edu