Visual Attention in Computer Graphics

Matthias Bernhard
Visual Attention in Computer Graphics
Supervisor: Michael Wimmer
Duration: 2009 - 2014

Information

Abstract

This thesis is concerned with gaze analysis methods to study visual attention in interactive 3D computer-graphics applications, such as virtual environments or computer games. Under this scope, research has been carried out in two directions: On the one hand, it was investigated how gaze analysis in three-dimensional virtual environments can be advanced. On the other hand, approaches were explored which improve three-dimensional graphics by taking into account visual attention of a user.

To advance gaze analysis in 3D computer graphics applications, two challenges have been addressed: First, inferring the object of attention at a certain point in time from the current output of an eye tracker – a technique which we denote as gaze-to-object mapping –, and second, deriving a statistical model for visual attention - a data structure we denote as importance map - from sequences of gaze samples recorded from many users. While addressing these challenges is a crucial step towards advancing gaze analysis and research on visual attention which employs modern computer graphics, the results may also be used in applications which attempt to perceptually optimize rendering. Thus, the third challenge addressed in this thesis was to explore an example application for attention-aware rendering techniques, where gaze-to-object mapping or importance maps can be employed to determine or predict the object of attention at run time. Thus, this thesis concludes with a pilot study on an application that dynamically adjusts the configuration of a stereo 3D display such that the object being attended by the user can be seen most comfortably.

Additional Files and Images

Weblinks

No further information available.

BibTeX

@phdthesis{Bernhard_Matthias_2014_VAC,
  title =      "Visual Attention in Computer Graphics",
  author =     "Matthias Bernhard",
  year =       "2014",
  abstract =   "This thesis is concerned with gaze analysis methods to study
               visual attention in interactive 3D computer-graphics
               applications, such as virtual environments or computer
               games. Under this scope, research has been carried out in
               two directions: On the one hand, it was investigated how
               gaze analysis in three-dimensional virtual environments can
               be advanced. On the other hand, approaches were explored
               which improve three-dimensional graphics by taking into
               account visual attention of a user.  To advance gaze
               analysis in 3D computer graphics applications, two
               challenges have been addressed: First, inferring the object
               of attention at a certain point in time from the current
               output of an eye tracker – a technique which we denote as
               gaze-to-object mapping –, and second, deriving a
               statistical model for visual attention - a data structure we
               denote as importance map - from sequences of gaze samples
               recorded from many users. While addressing these challenges
               is a crucial step towards advancing gaze analysis and
               research on visual attention which employs modern computer
               graphics, the results may also be used in applications which
               attempt to perceptually optimize rendering. Thus, the third
               challenge addressed in this thesis was to explore an example
               application for attention-aware rendering techniques, where
               gaze-to-object mapping or importance maps can be employed to
               determine or predict the object of attention at run time.
               Thus, this thesis concludes with a pilot study on an
               application that dynamically adjusts the configuration of a
               stereo 3D display such that the object being attended by the
               user can be seen most comfortably.",
  month =      dec,
  address =    "Favoritenstrasse 9-11/186, A-1040 Vienna, Austria",
  school =     "Institute of Computer Graphics and Algorithms, Vienna
               University of Technology",
  URL =        "https://www.cg.tuwien.ac.at/research/publications/2014/Bernhard_Matthias_2014_VAC/",
}