With the current technology, Virtual Production (VP) plays a more and more important role in the filming production process. One piece of important foundation within the XR technology is facial capture. I wanted to learn how to do the proper facial capture when I start using the AR filter a long time ago. To trigger the front camera and facial movement is not too hard, but I was thinking about how to interact with not only the front camera but also the back camera or use both cameras simultaneously. So I can place my facial capture result into reality via various AR functions. Luckily, I found a sample project on the Apple website that shows the potential of the hardware now supporting both cameras working together, which I wanted to make become the core tech design for my project. Combined the 2 key AR understanding concepts:

• Expression/emotions Real-time Interaction

• Spacial World Display and Interaction

By using the back camera to display reality physics space, meanwhile, obtaining the physical tracking position in the real world space.