Sunday, October 1, 2023


Augmented reality (AR) allows developers to create immersive and interactive experiences that blend the physical and virtual worlds. Face-tracking AR apps are a popular form of AR that tracks a user’s facial features and overlays virtual content on their face in real-time. In this guide, we will explore how to build a face-tracking AR app using ARCore and Unity.

Overview of Face-tracking AR Apps

Face-tracking AR apps use computer vision algorithms and machine learning models to detect and track a user’s facial features, such as their eyes, nose, mouth, and eyebrows. This technology enables developers to create personalized and interactive experiences that respond to the user’s emotions, movements, and gestures. Popular examples of face-tracking AR apps include Snapchat filters, Instagram face filters, and Face ID on iPhones.

Benefits of Building a Face-tracking AR App with ARCore and Unity

ARCore is Google’s platform for building AR experiences on Android devices, while Unity is a popular game engine and development tool that supports AR development. By combining ARCore and Unity, developers can leverage advanced AR features, such as motion tracking, environmental understanding, and light estimation, to create high-quality face-tracking AR apps. Additionally, Unity provides a user-friendly interface and a large community of developers and resources.


To follow this guide, you will need the following:

  • An Android device that supports ARCore
  • The latest version of Unity
  • The ARCore SDK for Unity
  • A basic understanding of Unity and C# programming

Setting Up the ARCore SDK and Unity

Installing Unity

The first step in building a face-tracking AR app with ARCore and Unity is to download and install Unity. Unity is a game development platform that offers a range of powerful tools for creating immersive AR experiences. You can download the latest version of Unity from the official website. Once downloaded, simply run the installer and follow the on-screen instructions to complete the installation process.

Setting Up ARCore Support in Unity

Next, you’ll need to set up ARCore support in Unity. This involves installing the ARCore SDK package from the Unity Asset Store and enabling ARCore support in your project settings. To do this, open Unity and create a new project. Then, navigate to the Unity Asset Store and search for the ARCore SDK. Download and import the package into your Unity project.

Importing the ARCore SDK

Once you’ve imported the ARCore SDK package into Unity, you’ll need to enable ARCore in your project settings. To do this, go to your project’s Player settings and check the “ARCore Supported” checkbox under the “XR Settings” tab. This will enable ARCore support in your Unity project, allowing you to create face-tracking AR apps using the ARCore SDK.

Building the Face-tracking AR App

After setting up the ARCore SDK and Unity, you can begin building your face-tracking AR app. The following steps will guide you through the process.

Creating a New Scene in Unity

Open the Unity editor and create a new scene. For simplicity, you can delete the default camera and add an ARCore Tracked Camera prefab to the scene.

Loading the ARCore Face-tracking Prefab

You can find the ARCore Face-tracking prefab in the ARCore SDK. Import the SDK into Unity and drag the prefab into your scene to add face-tracking functionality to your app.

Configuring ARCore Face-tracking

You can configure several settings for the ARCore Face-tracking prefab, including detection and tracking options. Use these settings to optimize performance and accuracy of face tracking in your app.

Adding AR Content to the Scene

Once you have added face-tracking functionality, you can add AR content to the scene. You can create your own AR content or use pre-made assets. Use the Unity editor to position and scale your AR content to fit the user’s face.

Building and Launching the App

Finally, you can build and launch your app to a supported device. Unity provides various build options for Android and iOS devices. Once you have built your app, test it on a device to ensure that face-tracking and AR content display correctly.



The article provided a step-by-step guide on how to build a face-tracking AR app with ARCore and Unity. The article started with an introduction that provided a brief overview of face-tracking AR apps and the benefits of building one with ARCore and Unity. The article then listed the prerequisites for building the app and explained, in detail, how to set up the ARCore SDK and Unity. Finally, the article provided a detailed guide on how to build the face-tracking AR app, which included creating a new scene in Unity, loading the ARCore Face-tracking prefab, configuring ARCore Face-tracking, adding AR content to the scene, building, and launching the app.

Next Steps

Now that you have built a face-tracking AR app with ARCore and Unity, you can take your app to the next level by adding more features and functionality. You can incorporate more AR elements into your app, such as animated 3D models, and you can also experiment with different tracking technologies. Additionally, you can publish your app to the Google Play Store or other app stores, allowing users to download and use your app. With ARCore and Unity, the possibilities are endless, so have fun exploring and building your own AR apps!