WithTeeth: Denture Preview in Augmented Reality

Information

• Publication Type: Conference Paper
• Workgroup(s)/Project(s):
  • Smile Analytics: Visual Analytics for Realistic and Aesthetic Smile Design
• Date: October 2018
• ISBN: 978-3-03868-072-7
• Lecturer: Aleksandr Amirkhanov
• Address: https://diglib.eg.org/handle/10.2312/vmv20181250
• Event: VMV18
• Editor: Beck, Fabian and Dachsbacher, Carsten and Sadlo, Filip
• Call for Papers: Call for Paper
• Booktitle: Vision, Modeling and Visualization

Abstract

Dentures are prosthetic devices replacing missing or damaged teeth, often used for dental reconstruction. Dental reconstruction improves the functional state and aesthetic appearance of teeth. State-of-the-art methods used by dental technicians typically do not include the aesthetic analysis, which often leads to unsatisfactory results for patients. In this paper, we present a virtual mirror approach for a dental treatment preview in augmented reality. Different denture presets are visually evaluated and compared by switching them on the fly. Our main goals are to provide a virtual dental treatment preview to facilitate early feedback, and hence to build the confidence and trust of patients in the outcome. The workflow of our algorithm is as follows. First, the face is detected and 2D facial landmarks are extracted. Then, 3D pose estimation of upper and lower jaws is performed and high-quality 3D models of the upper and lower dentures are fitted. The fitting uses the occlusal plane angle as determined manually by dental technicians. To provide a realistic impression of the virtual teeth, the dentures are rendered with motion blur. We demonstrate the robustness and visual quality of our approach by comparing the results of a webcam to a DSLR camera under natural, as well as controlled lighting conditions.

Additional Files and Images

Weblinks

No further information available.

BibTeX

@inproceedings{amirkhanov-2018-withteeth,
  title =      "WithTeeth: Denture Preview in Augmented Reality",
  author =     "Aleksandr Amirkhanov and Artem Amirkhanov and Matthias
               Bernhard and Zsolt Toth and Sabine Stiller and Andreas Geier
               and Eduard Gr\"{o}ller",
  year =       "2018",
  abstract =   "Dentures are prosthetic devices replacing missing or damaged
               teeth, often used for dental reconstruction. Dental
               reconstruction improves the functional state and aesthetic
               appearance of teeth. State-of-the-art methods used by dental
               technicians typically do not include the aesthetic analysis,
               which often leads to unsatisfactory results for patients. In
               this paper, we present a virtual mirror approach for a
               dental treatment preview in augmented reality. Different
               denture presets are visually evaluated and compared by
               switching them on the fly. Our main goals are to provide a
               virtual dental treatment preview to facilitate early
               feedback, and hence to build the confidence and trust of
               patients in the outcome. The workflow of our algorithm is as
               follows. First, the face is detected and 2D facial landmarks
               are extracted. Then, 3D pose estimation of upper and lower
               jaws is performed and high-quality 3D models of the upper
               and lower dentures are fitted. The fitting uses the occlusal
               plane angle as determined manually by dental technicians. To
               provide a realistic impression of the virtual teeth, the
               dentures are rendered with motion blur. We demonstrate the
               robustness and visual quality of our approach by comparing
               the results of a webcam to a DSLR camera under natural, as
               well as controlled lighting conditions.",
  month =      oct,
  isbn =       "978-3-03868-072-7",
  address =    "https://diglib.eg.org/handle/10.2312/vmv20181250",
  event =      "VMV18",
  editor =     "Beck, Fabian and Dachsbacher, Carsten and Sadlo, Filip",
  booktitle =  "Vision, Modeling and Visualization",
  URL =        "https://www.cg.tuwien.ac.at/research/publications/2018/amirkhanov-2018-withteeth/",
}