header > abstract > paper > figures > further results > footer

Multiple Views and Magic Mirrors -
Multimodal Volume Visualization of the Human Brain

by A. König, H. Doleisch, and E. Gröller.

Project Duration: March - November 1998.

This page assembles some results (figures) of work that is part of our research topic ``Visualization of Medical Data''. The figures are provided in JPEG format. Further results (figures and animations) are povided in various formats as stated for each of the results.

header < abstract > paper > figures > further results > footer

Abstract of the Paper:

Multimodal visualization of functional and anatomical data of the human brain is an important field in medical volume visualization. The aim of this application is to provide the user with information on the location of functional activations in the different regions of the brain. When the approach of direct volume rendering is chosen, the visual impression of details usually suffers from accumulating the image from colors and opacities derived from the data set. We present extensions to overcome this problem: Transfer function volumes are used for the highlighting of activated regions. Multiple views simplify the task of localizing these parts of the brain. Complementary information is brought into the visualization by Magic Mirrors in order to enhance the comprehensive view of the multimodal arrangement of volume data sets.

header < abstract < paper > figures > further results > footer

Download the paper (.ps.gz) (~2.6MB)

Download the paper (.pdf) (~10.5MB)

header < abstract < paper < figures > further results > footer

Figures in the paper (JPEG)

[Fig. 1] Figure 1:
Conventional approaches to multimodal visualization. Top, selected MRI slices are merged with functional data by pixel interleaving. Middle, the maximum intensities of the data are projected onto axial, coronal and sagital planes bearing brain outlines and millimetric Talairach coordinates. Bottom, the maximum data intensities are projected along the line of sight onto the cortical surface.
[Fig. 2] Figure 2:
Different problems arise when using direct volume rendering. When surface rendering is employed, the regions of activation are hidden by the cerebral cortex (right hand side). Left, very low opacity allows deeper structures to be visualized. However, it is hard to tell, where the foci reside exactly.
[Fig. 4a][Fig. 4b] Figure 4a and Figure 4b:
The principle of placing image planes as multiple views of the scene for enhancing volume visualization: without (left) and with (right) textures added.
[Fig. 5a][Fig. 5b] Figure 5a and Figure 5b:
Left: Using multiple views, the exact localization of activations is also possible with transparent transfer functions; Right: Even occluded regions like the cutaway part become obvious with the help of multiple views.
[Fig. 7] Figure 7:
Magic Mirrors with different transfer functions (left and right mirrors) and projective view (bottom mirror).
[Fig. 8] Figure 8:
Magic Mirrors with contour display (left mirror).

header < abstract < paper < figures < further results > footer

Further Results:

For further results obtained during the work done for this project (images, animations and links), please have a look at http://www.cg.tuwien.ac.at/research/vis/vismed/MM/Results/.

header < abstract < paper < figures < further results < footer

This page was last updated by Helmut Doleisch on February 19, 1999.
If you have any comments, please send a message to helmut@cg.tuwien.ac.at.