This technology allows us to interact with objects filmed just by having the computer study the micro movements in the video. So for example, we could put a 3D character into a scene and have them move objects around in a natural way without reconstructing the objects or scene in 3D. It is quite amazing.
