Image via Weyo  "We just thought [ARKit 3] is a fantastic, gigantic toolbox with tricks. [We wanted to see] what we [could do with] technology for amazing immersive interactive experiences for kids, "said Baz Palmer, co-founder of Weyo (the game's developer), in an interview with Next Reality.
Palmer and his team utilized ARKit's feature set for both rear and front cameras. For example, on the rear camera, children can help the Cookie Monster to bake cookies. On the front camera, they can become Ernie and try on different clothes.
Image via Weyo
Using ARKit 3 multi-face tracking technology allows parents to play with their children, with each face wearing a different character mask that tracks the individual as he or she moves within the camera view.
"Working with Sesame brands, you've got these lovely characters and have a really clear demographic that will try to get involved," says Palmer. "It really focused on how we want to use the technology."
Image via Weyo
Weyo originally included elements that also utilized the People Occlusion and Motion Capture features in ARKit 3, but according to Palmer, the team excluded these features from the final release to keep the app easier, however, they plan to offer these experiences later as additions to the app.
Because the app uses ARKit 3, it will be limited to compatible iPhones and iPads, namely the iPhone
X S X Max, and S X 2019 editions of iPad Air and iPad Mini, o ch the latest 11-inch and 12.9-inch iPad Pro models. R
This is not Sesame Street Workshop's first attack on augmented reality. In 2013, the organization integrated the Vuforia AR platform into
Big Bird's Words, an educational game that used Vuforia's computer vision to help players find words in the real world. Vuforia also supplied AR behind a prototype AR game.
Still, Sesame Street Yourself is the first household brand to adopt ARKit 3, which is significant considering that ARKit 2 was never really captured. The uniqueness of People Occlusion and Motion Capture may just be the secret ingredient for getting app developers to build more innovative AR experiences.
Don't Miss: NR30: Next Reality's 30 People to Watch in Augmented Reality for 2019