Augmented Reality Smile Application

About project

Smart Tek created the app that allows you to pick the perfect smile for your jawline and take a selfie picture using an iOS/Android camera while switching your teeth with friends and family. Augmented reality gives camera lenses intelligence, allowing them to recognize what’s in front of them contextually. Leading industries have already started using Computer Vision and AR algorithms to make a powerful impact with their latest products and services. Computer Vision can be used as an interactive and engaging way to demonstrate different products to your potential customers.

AR Smile would work like Snapchat by augmenting a teeth region with a filter, providing a perfect-looking smile. The application would enable the patient to take a picture on the front and back camera, save it, choose an impeccable smile from a database and take a picture with a new smile within seconds. This should be made possible by augmented reality: a picture is taken of the patient’s own teeth, on which a virtual model of the new set of teeth is superimposed.

Business challenge

What kind of smile suits you best? This question undoubtedly interests millions of people worldwide. While traditional dentistry approaches could showcase your future smile only in images, AR technology introduces a new approach to this practice. With this inspiring challenge in mind, Smart Tek created an innovative AR app to transform the way patients preview their smiles.

Smart Tek approach

To complete this project, we used Unity 3D, Computer Vision Algorithms, Haar Cascades Algorithm, and Face Landmark Recognition. The application enables an easy and fast experience by using computer vision algorithms. The solution can significantly facilitate the teeth whitening process or users can adopt it for socializing and fun. The AR Smile works offline, allowing the user to view teeth in the menu or add smiles into the database.

The users can hold a phone camera in front of them and try on a new smile. Once the system locks onto the user’s mouth and teeth, it overlays the chosen teeth. With just a few swipes, it is possible to configure the teeth’ smoothness, scale, vagueness, and height. The user or patient can see how this alters their facial appearance in real-time and then choose which variant suits them better.

Value delivered

Thanks to using new augmented technologies, Smart Tek has managed to achieve good results. Dentists can apply this solution to show their patients how their teeth would look after a particular medical procedure.

Using Face Landmark Recognition, the app identifies the smile in the image and substitutes it on other smiles to determine the best fit. The users can also adjust the size and shape of the teeth to match their mouths on the picture.