Fraunhofer HHI’s innovative reconstruction process makes it possible to generate natural-seeming, dynamic 3D models of people, the effects of which – in terms of authenticity and realism – far exceed conventional animations of virtual characters. The 3D models are created based on a large number of different video perspectives, thus accurately reconstructing gestures, facial expressions and textures (skin, hair and fabric) and making it possible to realistically reflect even facial movements and moving clothing.
The 3D models of the people are then integrated into a virtual scene. This gives viewers the option to observe the virtualized people with Virtual Reality glasses at very close range and from different angles. This technology allows viewers to immerse themselves directly in the scene and experience the story close up. They encounter a totally new type of immersion and virtual sensation.
Some applications enable viewers not only to move around freely within the scene, but also to use a hand controller, serving as an illuminant (e. g. a torch) in the virtual world, to change the level of lighting in the scene interactively. By using it, users can go on a discovery tour within the scene.