Authors: Aleksandr Amirkhanov, Artem Amirkhanov, Matthias Bernhard, Zsolt Toth, Sabine Stiller, Andreas Geier, Eduard Gröller, Gabriel Mistelbauer
Venue: Vision, Modeling and Visualization
DOI: https://doi.org/10.2312/VMV.20181250
Abstract
Dentures are prosthetic devices replacing missing or damaged teeth, often used for dental reconstruction. Dental reconstruction improves the functional state and aesthetic appearance of teeth. State-of-the-art methods used by dental technicians typically do not include the aesthetic analysis, which often leads to unsatisfactory results for patients. In this paper, we present a virtual mirror approach for a dental treatment preview in augmented reality. Different denture presets are visually evaluated and compared by switching them on the fly. Our main goals are to provide a virtual dental treatment preview to facilitate early feedback, and hence to build the confidence and trust of patients in the outcome. The workflow of our algorithm is as follows. First, the face is detected and 2D facial landmarks are extracted. Then, 3D pose estimation of upper and lower jaws is performed and high-quality 3D models of the upper and lower dentures are fitted. The fitting uses the occlusal plane angle as determined manually by dental technicians. To provide a realistic impression of the virtual teeth, the dentures are rendered with motion blur. We demonstrate the robustness and visual quality of our approach by comparing the results of a webcam to a DSLR camera under natural, as well as controlled lighting conditions.
Video
Download
BibTeX
@InProceedings{amirkhanov2018withteeth,
author = {Amirkhanov, Aleksandr and Amirkhanov, Artem and Bernhard, Matthias and Toth, Zsolt and Stiller, Sabine and Geier, Andreas and Gr\"{o}ller, Eduard and Mistelbauer, Gabriel},
booktitle = {Vision, Modeling and Visualization},
title = {{WithTeeth}: Denture Preview in Augmented Reality},
year = {2018},
publisher = {The Eurographics Association},
doi = {10.2312/vmv.20181250},
isbn = {978-3-03868-072-7},
}