Non-Rigid Photometric Stereo with Colored Lights

Add to your list(s) Download to your calendar using vCal

• Gabriel J. Brostow (University of Cambridge)
• Wednesday 30 January 2008, 14:00-15:00
• TCM Seminar Room, Cavendish Laboratory, Department of Physics.

If you have a question about this talk, please contact David MacKay.

We present an algorithm and the associated capture methodology to acquire and track the detailed 3D shape, bends, and wrinkles of deforming surfaces. Moving 3D data has been difficult to obtain by methods that rely on known surface features, structured light, or silhouettes. Multispectral photometric stereo is an attractive alternative because it can recover a dense normal field from an un-textured surface. We show how to capture such data and register it over time to generate a single deforming surface.

Experiments were performed on video sequences of untextured cloth, filmed under spatially separated red, green, and blue light sources. Our first finding is that using zero-depth-silhouettes as the initial boundary condition already produces rather smoothly varying per-frame-reconstructions with high detail. Second, when these 3D reconstructions are augmented with 2D optical flow, one can register the first frame’s reconstruction to every subsequent frame.

This talk is part of the Inference Group series.

This talk is included in these lists:

• All Cavendish Laboratory Seminars
• All Talks (aka the CURE list)
• Biology
• CamTalks
• Centre for Health Leadership and Enterprise
• Cool science seminars
• DS list 1
• Featured lists
• Inference Group
• Inference Group Summary
• Joint Machine Learning Seminars
• Life Science
• Life Sciences
• ME Seminar
• Machine Learning Summary
• Neuroscience
• Neuroscience Seminars
• Neuroscience Seminars
• Neuroscience Seminars
• Required lists for MLG
• School of Physical Sciences
• Stem Cells & Regenerative Medicine
• TCM Seminar Room, Cavendish Laboratory, Department of Physics

Note that ex-directory lists are not shown.