The visualization environment is connected to a set of tools that allow professionals to construct and interact with content collaboratively. Filmakademie is developing tools to manipulate and direct virtual scenes and is researching new interfaces for intuitive interaction and control. UdS is researching new techniques to capture and control lights to seamlessly integrate real and virtual elements. iMinds is developing the building blocks to simplify the creation of performance spaces and installation art, and researching new approaches to create immersive holographic experiences.
Light Capture – Setup on-set
The University of Saarland have developed a prototype light probe to capture the position, orientation and characteristics of the physical lights on-set to harmonise the real and virtual lighting. This allows the physical lights to be used in rendering to produce believable content and the light capture has been integrated with on-set rendering so that the impact of lighting decisions can be visualized at the time of shooting.
On-set Tools – Interactive editing on-set
Filmakademie have prototyped and tested the impact of novel interfaces to provide intuitive control of on-set parameters in production through gestural input and head-mounted displays. This evaluation showed that tracked tablets provide an easily accessible tool as a “magic window” onto the virtual space. A multi-user tool has been developed that allows non-technical users control over the set layout, lighting and animation. This provides collaborative control of a highly complex film pipeline through a simple real-time interface.
On-set visualization environment
iMinds have developed a prototype visualization environment that allows filmed real-world imagery to be projected onto a physical space to create an immersive view without the need for a head-mounted display. New techniques have been developed to capture and calibrate the geometry of an arbitrary space to use as a display surface for multiple projectors and a tool chain has been created to render content for display. This provides the ability to create new holographic experiences for the performing arts and new methods of visualization to understand the virtual space on-set in film production.