Srinivas Rao¹    Rodrigo Ortiz-Cayon¹    Matteo Munaro¹    Aidas Liaudanskas¹    Krunal Chande¹

Tobias Bertel²    Christian Richardt²    Alexander J. B. Trevor³    Stefan Holzer¹    Abhishek Kar⁴

¹ Fyusion Inc.       ² University of Bath       ³ Robust.AI       ⁴ Google Inc.

Poster at SIGGRAPH Asia 2020

---

Abstract

We propose a system for free-viewpoint facial re-enactment from a casual video capture of a target subject. Our system can render and re-enact the subject consistently in all the captured views. Furthermore, our system also enables interactive free-viewpoint facial re-enactment of the target from novel views. The re-enactment of the target subject is driven by an expression sequence of a source subject, which is captured using a custom app running on an iPhone X. Our system handles large pose variations in the target subject while keeping the re-enactment consistent. We demonstrate the efficacy of our system by showing various applications.

Downloads

• Poster (PDF, 47 MB)
• Supplemental Video (MP4, 125 MB)
• Poster Abstract (PDF, 4 MB)

Bibtex

@InProceedings{HoloBot,
  author    = {Srinivas Rao and Rodrigo Ortiz-Cayon and Matteo Munaro and Aidas Liaudanskas and Krunal Chande and Tobias Bertel and Christian Richardt and Alexander J. B. Trevor and Stefan Holzer and Abhishek Kar},
  title     = {Free-Viewpoint Facial Re-Enactment from a Casual Capture},
  booktitle = {SIGGRAPH Asia Posters},
  year      = {2020},
  doi       = {10.1145/3415264.3425453},
  url       = {https://richardt.name/holobot/},
}