قالب وردپرس درنا توس
Home / Tips and Tricks / Apple iOS-powered Sesame Street Yourself app turns kids into their favorite characters through ARKit 3's new features «Mobile AR News: Next Reality

Apple iOS-powered Sesame Street Yourself app turns kids into their favorite characters through ARKit 3's new features «Mobile AR News: Next Reality



The long-term television series for children in the United States, Sesame Street has not survived 50 years without utilizing new technology on the road.

The latest innovation from Sesame Street Workshop is Sesame Street Yourself, a new iOS app that leverages the new features of ARKit 3.

Available now through the Apple App Store, Sesame Street Yourself uses ARKit & # 39; face tracking feature to identify and change users to their favorite Sesame Street characters. The ad-free app also entertains children ages 3-5 with games, singing and dancing.

Image via Weyo [19659006] "We just thought [ARKit 3] is a fantastic, gigantic toolbox with tricks. [We wanted to see] what we [could do with] technology for amazing immersive interactive experiences for kids, "said Baz Palmer, co-founder of Weyo (the game's developer), in an interview with Next Reality.

Palmer and his team utilized ARKit's feature set for both rear and front cameras. For example, on the rear camera, children can help the Cookie Monster to bake cookies. On the front camera, they can become Ernie and try on different clothes.

Image via Weyo

Using ARKit 3 multi-face tracking technology allows parents to play with their children, with each face wearing a different character mask that tracks the individual as he or she moves within the camera view.

"Working with Sesame brands, you've got these lovely characters and have a really clear demographic that will try to get involved," says Palmer. "It really focused on how we want to use the technology."

Image via Weyo

Weyo originally included elements that also utilized the People Occlusion and Motion Capture features in ARKit 3, but according to Palmer, the team excluded these features from the final release to keep the app easier, however, they plan to offer these experiences later as additions to the app.

Because the app uses ARKit 3, it will be limited to compatible iPhones and iPads, namely the iPhone X S X S Max, and X R 2019 editions of iPad Air and iPad Mini, o ch the latest 11-inch and 12.9-inch iPad Pro models.

This is not Sesame Street Workshop's first attack on augmented reality. In 2013, the organization integrated the Vuforia AR platform into Big Bird's Words, an educational game that used Vuforia's computer vision to help players find words in the real world. Vuforia also supplied AR behind a prototype AR game.

Still, Sesame Street Yourself is the first household brand to adopt ARKit 3, which is significant considering that ARKit 2 was never really captured. The uniqueness of People Occlusion and Motion Capture may just be the secret ingredient for getting app developers to build more innovative AR experiences.

Don't Miss: NR30: Next Reality's 30 People to Watch in Augmented Reality for 2019 [19659022]
Source link