Casual Real-World VR using Light Fields
Yusuke Tomoto1 Srinivas Rao1 Tobias Bertel2 Krunal Chande1 Christian Richardt2 Stefan Holzer1 Rodrigo Ortiz-Cayon1
1 Fyusion Inc. 2 University of Bath
Poster at SIGGRAPH Asia 2020
Abstract
Virtual reality (VR) would benefit from more end-to-end systems centered around a casual capturing procedure, high-quality visual results, and representations that are viewable on multiple platforms. We present an end-to-end system that is designed for casual creation of real-world VR content, using a smartphone. We use an AR app to capture a linear light field of a real-world object by recording a video sweep around the object. We predict multiplane images for a subset of input viewpoints, from which we extract high-quality textured geometry that are used for real-time image-based rendering suitable for VR. The round-trip time of our system, from guided capture to interactive display, is typically 1–2 minutes per scene.
Downloads
- Poster (PDF, 68 MB)
- Supplemental Video (MP4, 134 MB)
- Poster Abstract (PDF, 9 MB)
Bibtex
@InProceedings{HoloBot, author = {Yusuke Tomoto and Srinivas Rao and Tobias Bertel and Krunal Chande and Christian Richardt and Stefan Holzer and Rodrigo Ortiz-Cayon}, title = {Casual Real-World {VR} Using Light Fields}, booktitle = {SIGGRAPH Asia Posters}, year = {2020}, doi = {10.1145/3415264.3425452}, url = {https://richardt.name/llff4vr/}, }