Microsoft Research Shows Off Non-Rigid Reconstruction Of 3D Models Using an RGB-D Camera

At SIGGRAPH 2014, Microsoft Research demoed several new projects they have been working on. One of them was the controllable high-fidelity 3D facial performance transfer which allowed to transfer your facial expressions to a dog’s face. Read more about it here. Another interesting project is around of non-rigidly deforming physical objects with arbitrary shape in real-time. Watch the video above and the description below to know more.

Among Microsoft Research’s contributions to SIGGRAPH 2014, a combined hardware and software solution for markerless reconstruction of non-rigidly deforming physical objects with arbitrary shape in real-time. Our system uses a single self-contained stereo camera unit built from off-the-shelf components and consumer graphics hardware to generate spatio-temporally coherent 3D models at 30 Hz. A new stereo matching algorithm estimates real-time RGB-D data. The system is an order of magnitude faster than state-of-the-art methods, while matching the quality and robustness of many offline algorithms. We demonstrate how acquired models can be used for many interactive scenarios, including re-texturing, online performance capture and preview, and real-time shape and motion re-targeting.

Source: MSR

About the author  ⁄ pradeep

Pradeep, a Computer Science & Engineering graduate.

  • http://www.covertconsulting.com/ Kirk

    Cool stuff of the future.

  • Mr Wilburn

    The Wizard of Oz was doing this 75 years ago.