All the face-tracking tech behind the iPhone X’s Animoji

Elizabeth Stinson, Wired:

A COUPLE YEARS ago, Apple went on a shopping spree. It snatched up PrimeSense, maker of some of the best 3-D sensors on the market, as well Perceptio, Metaio, and Faceshift, companies that developed image recognition, augmented reality, and motion capture technology, respectively.

And:

Perhaps the most important feature in the new flagship phone is its face-tracking technology, which allows you to unlock the phone with your face or to lend your expressions to a dozen or so emoji with Animoji. Apple thinks the iPhone X represents the future of mobile tech, and for many, that’s true. But if you trace most of consumer technology’s most impressive accomplishments back to their origins, more often than not, it’ll lead you to a drab research lab full of graduate students. In the case of Animoji, that research happened to have taken place nearly a decade ago at a pair of Europe’s most prestigious technical schools.

And:

Algorithmic facial tracking is notoriously difficult pull off. Li calls the human face “one of the holy grails in computer graphics” because it’s so difficult to work on. Unlike a static object, the face is constantly deforming; there are no simple rules for a computer to follow.

This is a fascinating article. Animoji is not the goal, but rather a playful implementation that shows what is possible, how far Apple has come down this road.



2 thoughts on “All the face-tracking tech behind the iPhone X’s Animoji”

  1. Animoji is not the goal

    Agree. It seems like an ideal platform to signal Apple’s intentions – and it’s chops – in the area of VR.

  2. Which is why I’ll wait another year, MAYBE two. Animoji might not be the goal, but they’re what we get today and I don’t care about them. Nor do I desperately need to replace TouchID with FaceID even if the latter works perfectly. The X, like a lot of new gen products, probably sets the stage for a lot of stuff and in 4 or 5 years we’ll see that more clearly. But there’s little benefit to it NOW for most of us.

Leave a Reply

Your email address will not be published. Required fields are marked *