What makes kevin spacey look like kevin spacey
S Suwajanakorn, I Kemelmacher-Shlizerman…�- arXiv preprint arXiv�…, 2015 - arxiv.org
arXiv preprint arXiv:1506.00752, 2015•arxiv.org
We reconstruct a controllable model of a person from a large photo collection that captures
his or her {\em persona}, ie, physical appearance and behavior. The ability to operate on
unstructured photo collections enables modeling a huge number of people, including
celebrities and other well photographed people without requiring them to be scanned.
Moreover, we show the ability to drive or {\em puppeteer} the captured person B using any
other video of a different person A. In this scenario, B acts out the role of person A, but�…
his or her {\em persona}, ie, physical appearance and behavior. The ability to operate on
unstructured photo collections enables modeling a huge number of people, including
celebrities and other well photographed people without requiring them to be scanned.
Moreover, we show the ability to drive or {\em puppeteer} the captured person B using any
other video of a different person A. In this scenario, B acts out the role of person A, but�…
We reconstruct a controllable model of a person from a large photo collection that captures his or her {\em persona}, i.e., physical appearance and behavior. The ability to operate on unstructured photo collections enables modeling a huge number of people, including celebrities and other well photographed people without requiring them to be scanned. Moreover, we show the ability to drive or {\em puppeteer} the captured person B using any other video of a different person A. In this scenario, B acts out the role of person A, but retains his/her own personality and character. Our system is based on a novel combination of 3D face reconstruction, tracking, alignment, and multi-texture modeling, applied to the puppeteering problem. We demonstrate convincing results on a large variety of celebrities derived from Internet imagery and video.
arxiv.org