Casual Real-World VR using Light Fields

Yusuke Tomoto1    Srinivas Rao1    Tobias Bertel2    Krunal Chande1    Christian Richardt2    Stefan Holzer1    Rodrigo Ortiz-Cayon1

1 Fyusion Inc.       2 University of Bath

Poster at SIGGRAPH Asia 2020

Abstract

Virtual reality (VR) would benefit from more end-to-end systems centered around a casual capturing procedure, high-quality visual results, and representations that are viewable on multiple platforms. We present an end-to-end system that is designed for casual creation of real-world VR content, using a smartphone. We use an AR app to capture a linear light field of a real-world object by recording a video sweep around the object. We predict multiplane images for a subset of input viewpoints, from which we extract high-quality textured geometry that are used for real-time image-based rendering suitable for VR. The round-trip time of our system, from guided capture to interactive display, is typically 1–2 minutes per scene.

Downloads

Bibtex

@InProceedings{HoloBot,
  author    = {Yusuke Tomoto and Srinivas Rao and Tobias Bertel and Krunal Chande and Christian Richardt and Stefan Holzer and Rodrigo Ortiz-Cayon},
  title     = {Casual Real-World {VR} Using Light Fields},
  booktitle = {SIGGRAPH Asia Posters},
  year      = {2020},
  doi       = {10.1145/3415264.3425452},
  url       = {https://richardt.name/llff4vr/},
}