Current Research in Augmented and Virtual Reality

Details

VU, 186.865, 2017W

Hot Links

This course page describes the lecture of Wintersemester 2017/2018. See list of other semesters.

Current

This course is only offered in WS 2017 by Guest Professor Henry Fuchs (UNC Chapel Hill, USA). It will be held in English.

* This course is valid for the module "Virtual and Augmented Reality" of the Studienplan "Visual Computing". (wird für dieses Modul angerechnet)

Introduction: Tuesday, 3rd October, 2017, at 15:00-16:00 in the Seminar room 186 (Favoritenstraße 9, 5th floor).

general information

The lectures are planned to be on the following days, but may change:
 **** PLEASE CHECK THIS PAGE FOR LATEST SCHEDULE OF CLASSES ****

Tue 03.10.2017 15:00 - 16:00 Henry Fuchs
Tue 17.10.2017 15:00 - 18:00 Assistant Prof. Gordon Wetzstein, Stanford U, USA (via Skype)*
Tue 24.10.2017 15:00 - 18:00 Dr. Kaan Aksit, NVIDIA Research (via Skype) **
Tue 31.10.2017 15:00 - 18:00 Dr. Andrew Maimone, Oculus Research, Facebook (via Skype) ***
Mon 13.11.2017 13:00 - 16:00 Professor Greg Welch, U of Central Florida, USA (in person) ****
Tue 05.12.2017 15:00 - 18:00 Dr. Mingsong Dou, PerceptiveIO (via Skype) *****
Tue 12.12.2017 15:00 - 18:00 Henry Fuchs
Tue 19.12.2017 15:00 - 18:00 Student presentations (20-25 min. each, randomly chosen in class) - LAST CLASS

Before each class meeting the instructor will list near the bottom of this page (near the course bibliography) a paper or two that relates to the topic of the upcoming lecture. Students are encouraged to read those one or two papers to be better prepared for the lecture.

For more information please see TISS, but note that latest details will be on this page (at cg.tuwien.ac.at)

SUGGESTED READINGS and SLIDES related to lectures

* 17.10.2017 Gordon Wetzstein, Stanford U
     (found at http://www.computationalimaging.org/publications/ )

R. Konrad, N. Padmanaban, K. Molner, E. A. Cooper, G. Wetzstein. “Accommodation-invariant Computational Near-eye Displays”, ACM SIGGRAPH (Transactions on Graphics 36, 4), 2017.

R. Konrad, D. G. Dansereau, A. Masood, G. Wetzstein. “SpinVR: Towards Live-Streaming 3D Virtual Reality Video”, ACM SIGGRAPH Asia (Transactions on Graphics 36, 6), 2017

Slides from Gordon Wetzstein:
https://drive.google.com/open?id=0BzPBb-sAjcCZS2EydGU2M3BMZWM        https://drive.google.com/open?id=0BzPBb-sAjcCZdUhESkpvNUt2UGs

** 24.10.2017 Kaan Aksit, NVIDIA Research

G. Kramida and A. Varshney, “Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays,” IEEE Transactions on Visualization and Computer Graphics, vol. 22, no. 7, pp. 1912–1931, Jul. 2016.

H. Hua, “Enabling Focus Cues in Head-Mounted Displays,” Proceedings of the IEEE, vol. 105, no. 5, pp. 805–824, May 2017.

Two reliable sources/books for introduction to holography:

(1) Graham Saxby and Stanislovas Zacharovas. 2016. Practical Holography (fourth edition). CRC Press, Taylor & Francis Group, LLC, 6000 Broken Sound Parkway, NW, Suite 300, Boca Raton, FL 33487-2742.

(2) Gerhard Ackermann and Juergen Eichler. 2007. Holography: A Practical Approach. Wiley-VCH Verlag GmbH & Co. KGaA, Weinheim.

Slides and additional paper from Kaan Aksit: see Attachments at the bottom of this page.

*** 31.10.2017 Andrew Maimone

A. Maimone, A. Georgiou, J. Kollin, "Holographic Near-Eye Displays for Virtual and Augmented Reality," SIGGRAPH 2017.   
https://www.microsoft.com/en-us/research/wp-content/uploads/2017/05/hol…

**** 13.11.2017 Greg Welch

Greg Welch. HISTORY: The Use of the Kalman Filter for Human Motion Tracking in Virtual Reality. Presence: Teleoperators and Virtual Environments, 18(1), 2009
http://www.cs.unc.edu/~welch/media/pdf/Welch2009aa.pdf

Greg Welch and Eric Foxlin (2002). Motion Tracking: No Silver Bullet, but a Respectable Arsenal, IEEE Computer Graphics and Applications, special issue on Tracking, November/December 2002, 22(6): 24–38. Invited submission.
http://www.cs.unc.edu/~welch/media/pdf/cga02_welch_tracking.pdf

Bonnie Danette Allen, Gary Bishop, and Greg Welch. Tracking: Beyond 15 Minutes of Thought, SIGGRAPH 2001 course 11. In Computer Graphics, Annual Conference on Computer Graphics & Interactive Techniques. ACM Press, Addison-Wesley, Los Angeles, CA, USA (August 12–17), SIGGRAPH 2001 course pack edition, 2001. (The course slides are also available.)
http://www.cs.unc.edu/~tracker/ref/s2001/tracker/

Greg Welch and Gary Bishop. An Introduction to the Kalman Filter, SIGGRAPH 2001 course 8. In Computer Graphics, Annual Conference on Computer Graphics & Interactive Techniques. ACM Press, Addison-Wesley, Los Angeles, CA, USA (August 12–17), SIGGRAPH 2001 course pack edition, 2001. (The course slides are also available.)
http://www.cs.unc.edu/~tracker/ref/s2001/kalman/

***** 05.12.2017 Mingsong Dou

Mingsong Dou, Sameh Khamis, Yury Degtyarev, Philip Davidson, Sean Fanello, Adarsh Kowdle, Sergio Orts Escolano, Christoph Rhemann, David Kim, Jonathan Taylor, Pushmeet Kohli, Vladimir Tankovich, Shahram Izadi. Fusion4D: Real-time Performance Capture of Challenging Scenes (SIGGRAPH 2016).

Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L. Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A. Chou, Sarah Mennicken, Julien Valentin, Vivek Pradeep, Shenlong Wang, Sing Bing Kang, Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin, and Shahram Izadi. 2016. Holoportation: Virtual 3D Teleportation in Real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 741-754.

ASSIGNMENTS:

All assignments should be submitted by email to hfuchs@cg.tuwien.ac.at.

Assignment 1: Due noon, 24.10.2017.  Submit a list of 5 papers from the Bibliography of the class (attached below) one of which you would be interested in presenting in class. Submit also a list of 3 to 5 papers in AR/VR that are not in the Bibliography, one of which you would be interested in presenting in class.  List these 8-10 papers in order of most-to-least interest to you.

(Instructor will assign a paper to each student by 07.11.2017.)

Assignment 2: Due noon, 05.12.2017. Submit a set of slides (in PowerPoint or Keynote) that you have prepared with which you would make a 25-minute presentation in class on the paper assigned to you. Be sure to give credit to the source of any material that you are using, such as text, slide, image or video.

CLASS GRADE will depend on

1) Attendance in class: each student is expected to attend at least 2/3 of the class sessions.

2) Participation in class discussions after each presentation. Part of this participation will be involve each student submitting to the instructor, via email, at least one question on each presentation. We will take a few minutes after each presentation and before oral discussions, to give each student time to email the instructor these one or two questions the student would like to ask of the speaker.

3) Class presentation by the student on the single paper assigned to them, or if the student’s paper was not selected for presentation due to lack of class time, then this part of the grade will be based on the presentation material submitted.

Attachments

Attachment Size
TU_Wien_Bibliography2017.10.03_13.21.pdf 82.56 KB
kaan_aksit_varifocal_AR_display_siggraph-asia_2017.pdf 61.93 MB
Kaan_Aksit_slides.pdf 5.48 MB
Gordon_Wtzstein-2017.10.17-vienna_seminar.pdf 65.87 MB
Dou_Mingsong_2017.12.05-3D-Capture-Talk.pdf 67.99 MB
Fuchs_TU_Wien_class_2017.12.12.pdf 51.14 MB
Aichner_Lea-Izadi2011KinectFusion.pdf 3.09 MB
Gorgl_Anton-Opris2012VR_anxiety_therapy.pdf 384.74 KB
Hasimbegovic_Amina-AymerichFranch2014Virtual_Self_Similarity_and_Social_Anxiety.pdf 1.61 MB
Koch_Samuel-Raskar1998office_of_the_future.pdf 7.6 MB
Krawczyk_Krzysztof-Jones2007_360light_field_display.pdf 1.95 MB
Leopold_Niko-Miyazaki2014multi-user_autostereoscopic_display.pdf 924.84 KB
Mirzaei_Mohammadreza-Hendersonfeiner2011AR_Procedural_task.pdf 3.45 MB
Musil_Tomas-Mehrabi2013_Depth_cues_and_3d_displays.pdf 33.64 MB
Pegoraro_Julian-_Sajadi2013_Projectors_optical_pixel_shift_.pdf 16.56 MB
Sippl_Tobias-_Engel2016_direct_sparse_odometry.pdf 1.2 MB
Sohajda_Katalin-Qian2015_VR_laparo_simulation.pdf 60.61 MB
Stojanoski_Stefan-_Nguyencanny2007_Improving_Trust_in_Group_Video_Conferencing.pdf 1.91 MB
Zafirova_Deana-_Meehan2002_Physiological_Measures_of_Presence.pdf 4.19 MB