Megastereo: Constructing High-Resolution Stereo Panoramas

Christian Richardt ^1,2 Yael Pritch ¹ Henning Zimmer ^1,3 Alexander Sorkine-Hornung ¹

¹ Disney Research Zurich ² REVES/Inria Sophia Antipolis ³ ETH Zurich

Computer Vision and Pattern Recognition 2013 — oral presentation

Abstract

We present a solution for generating high-quality stereo panoramas at megapixel resolutions. While previous approaches introduced the basic principles, we show that those techniques do not generalise well to today’s high image resolutions and lead to disturbing visual artefacts. As our first contribution, we describe the necessary correction steps and a compact representation for the input images in order to achieve a highly accurate approximation to the required ray space. Our second contribution is a flow-based upsampling of the available input rays which effectively resolves known aliasing issues like stitching artefacts. The required rays are generated on the fly to perfectly match the desired output resolution, even for small numbers of input images. In addition, the upsampling is real-time and enables direct interactive control over the desired stereoscopic depth effect. In combination, our contributions allow the generation of stereoscopic panoramas at high output resolutions that are virtually free of artefacts such as seams, stereo discontinuities, vertical parallax and other mono-/stereoscopic shape distortions. Our process is robust, and other types of multi-perspective panoramas, such as linear panoramas, can also benefit from our contributions. We show various comparisons and high-resolution results.

Downloads

Paper (PDF, 5.8 MB)
Talk at CVPR (Vimeo)
Poster shown at CVPR (PDF, 0.8 MB)
Presentation slides (Keynote ’09, 84 MB) — PDF export of slides (4 MB)
Supplemental Video (MP4, 98 MB) — This is the same video as above (included from Vimeo).

Disclosure: This work is covered by United States Patent US9398215B2.

Bibtex

@inproceedings{Megastereo,
  author    = {Christian Richardt and Yael Pritch and Henning Zimmer and Alexander Sorkine-Hornung},
  title     = {Megastereo: Constructing High-Resolution Stereo Panoramas},
  booktitle = {Conference on Computer Vision and Pattern Recognition (CVPR)},
  year      = {2013},
  month     = {June},
  pages     = {1256--1263},
  doi       = {10.1109/CVPR.2013.166},
  url       = {http://richardt.name/megastereo/},
}