Reciprocal Shading for Mixed Reality
Project duration: February 2009 - January 2013
Project Leader: Christoph Traxler
Funding:
FFG 820916 - FIT-IT Visual Computing
General Information
The aim of the RESHADE project is to simulate the mutual influence between real and virtual objects in mixed reality applications. Virtual objects in such applications appear disturbingly artificial because rendering completely ignores the real environment. But from the term mixed reality one would expect that virtual and real object harmoniously blend into one visual perception and cannot be distinguished easily.
The ambitious goal of this project is to provide users with a perfect illusion, so that they cannot perceive a difference between virtual and real objects. That means virtual objects are responsive to changes in the real environment in real time. They have to be rendered in a believable realistic way so that they smoothly blend with reality. It is also important to simulate the visual effects of virtual objects on real ones.
Besides for realistic rendering this technique can also be used for innovative ways of interaction and dynamic behaviour of virtual objects, which are key aspects of mixed reality.
Research focuses on real time rendering algorithms for mixed reality applications that consider the lighting and geometry of the real environment. Special cameras will continuously capture reality. The real geometry will also be used to simulate effects of virtual objects on real ones in real time. Shading of real objects will be corrected by digital composition.
Research results will be repeatedly evaluated in the course of the project within three different application scenarios. Thereby human perception is the sole key factor for assessment of the quality of the solution.
Publications
8 Publications found:| 2012 | ||
|---|---|---|
| Adam Celarek Merging Ray Tracing and Rasterization in Mixed Reality [  paper] |
Bachelor Thesis | |
| Stefan Spelitz Color Distribution Transfer For Mixed-Reality Applications [ thesis] |
Bachelor Thesis | |
| Martin Knecht, Christoph Traxler, Oliver Mattausch, Michael Wimmer Reciprocal Shading for Mixed Reality Computers & Graphics, 36(7):846-856, November 2012. [ draft] |
Journal Paper (without talk) | |
| Martin Knecht, Georg Tanzmeister, Christoph Traxler, Michael Wimmer Interactive BRDF Estimation for Mixed-Reality Applications Journal of WSCG, 20(1):47-56, June 2012. [ paper] |
Journal Paper with Conference Talk | |
| 2011 | ||
| Martin Knecht, Andreas Dünser, Christoph Traxler, Michael Wimmer, Raphael Grasset A Framework For Perceptual Studies In Photorealistic Augmented Reality In Proceedings of the 3rd IEEE VR 2011 Workshop on Perceptual Illusions in Virtual Environments, pages 27-32. March 2011. [ paper] |
Conference Paper | |
| Martin Knecht, Christoph Traxler, Werner Purgathofer, Michael Wimmer Adaptive Camera-Based Color Mapping For Mixed-Reality Applications In Proceedings of the 2011 IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2011), pages 165-168. October 2011. [ Preprint] [ Video] |
Conference Paper | |
| Patrick Kühtreiber, Martin Knecht, Christoph Traxler BRDF approximation and estimation for Augmented Reality In 15th International Conference on System Theory, Control and Computing, pages 318-324. October 2011. [ Paper] |
Conference Paper | |
| 2010 | ||
| Martin Knecht, Christoph Traxler, Oliver Mattausch, Werner Purgathofer, Michael Wimmer Differential Instant Radiosity for Mixed Reality In Proceedings of the 2010 IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2010), pages 99-107. October 2010. [ paper] |
Conference Paper | |
