2
$\begingroup$

Last year Apple releases their new phone Apple X that has an exciting feature called Animoji. I am so fascinated by this technology that I really want to make my own version of it. But the problem is I am really new in image processing stuff and I've no idea about the technology behind Animoji. So what is the technology behind the Applle Animoji and what sort of knowledge should I have if I want to build my own version of Animoji from scratch?

$\endgroup$
6
  • 2
    $\begingroup$ xkcd.com/1838 $\endgroup$
    – endolith
    Commented Feb 7, 2018 at 18:15
  • $\begingroup$ @endolith, I haven't got any clue from your link. $\endgroup$
    – opu 웃
    Commented Feb 7, 2018 at 18:30
  • $\begingroup$ Sorry. I'm joking that it's probably based on neural networks, and so nobody really knows how it works. We can dissect the networks and find out what they're doing at certain layers, but that's about it. More deterministic facial tracking algorithms were used in the past, but it's my understanding that everything is neural networks now because they work better. I could be wrong. $\endgroup$
    – endolith
    Commented Feb 7, 2018 at 19:19
  • $\begingroup$ I would be watching their research blog very closely ;) $\endgroup$
    – jojeck
    Commented Feb 7, 2018 at 21:27
  • 1
    $\begingroup$ @jojek, would you please share the link of their research blog. $\endgroup$
    – opu 웃
    Commented Feb 8, 2018 at 18:14

1 Answer 1

3
$\begingroup$

It's more like a soft answer (I am happy to update it later), but Alex Acero explained the technology behind aniomoji on this years ICASSP 2018. Here is the link. Basically, they are using so-called Blendshapes to estimate the positions of the muscles and then they are mapping them to the actual animoji model.

$\endgroup$
3
  • 1
    $\begingroup$ I attended this talk, and I should say that I was p*ssed by the fuzz around this. $\endgroup$ Commented May 17, 2018 at 12:10
  • 1
    $\begingroup$ Personally, I hated the last 20 minutes. It was like a pitch for Apple. $\endgroup$
    – jojeck
    Commented May 17, 2018 at 12:11
  • 2
    $\begingroup$ Same, my mind switched off, and I spent the rest of the time reading the abstract book. $\endgroup$ Commented May 17, 2018 at 12:14

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.