Publications

2024

IntrinsicDiffusion: Joint Intrinsic Layers from Latent Diffusion Models
Jundan Luo, Duygu Ceylan, Jae Shin Yoon, Nanxuan Zhao, Julien Philip, Anna Frühstück, Wenbin Li, Christian Richardt and Tuanfeng Y. Wang
SIGGRAPH 2024

PlatoNeRF: 3D Reconstruction in Plato’s Cave via Single-View Two-Bounce Lidar
Tzofi Klinghoffer, Xiaoyu Xiang, Siddharth Somasundaram, Yuchen Fan, Christian Richardt, Ramesh Raskar and Rakesh Ranjan
Conference on Computer Vision and Pattern Recognition (CVPR) 2024 (oral/award candidate, 0.8%/0.2% acceptance rate)

HybridNeRF: Efficient Neural Rendering via Adaptive Volumetric Surfaces
Haithem Turki, Vasu Agrawal, Samuel Rota Bulò, Lorenzo Porzi, Peter Kontschieder, Deva Ramanan, Michael Zollhöfer and Christian Richardt
Conference on Computer Vision and Pattern Recognition (CVPR) 2024 (highlight, 2.8% acceptance rate)

SpecNeRF: Gaussian Directional Encoding for Specular Reflections
Li Ma, Vasu Agrawal, Haithem Turki, Changil Kim, Chen Gao, Pedro V. Sander, Michael Zollhöfer and Christian Richardt
Conference on Computer Vision and Pattern Recognition (CVPR) 2024 (highlight, 2.8% acceptance rate)

Real Acoustic Fields: An Audio-Visual Room Acoustics Dataset and Benchmark
Ziyang Chen, Israel D. Gebru, Christian Richardt, Anurag Kumar, William Laney, Andrew Owens and Alexander Richard
Conference on Computer Vision and Pattern Recognition (CVPR) 2024 (highlight, 2.8% acceptance rate)

ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models
Lukas Höllein, Aljaž Božič, Norman Müller, David Novotny, Hung-Yu Tseng, Christian Richardt, Michael Zollhöfer and Matthias Nießner
Conference on Computer Vision and Pattern Recognition (CVPR) 2024

CRefNet: Learning Consistent Reflectance Estimation With a Decoder-Sharing Transformer
Jundan Luo, Nanxuan Zhao, Wenbin Li and Christian Richardt
IEEE Transactions on Visualization and Computer Graphics (pre-print)

2023

VR-NeRF: High-Fidelity Virtualized Walkable Spaces
Linning Xu, Vasu Agrawal, William Laney, Tony Garcia, Aayush Bansal, Changil Kim, Samuel Rota Bulò, Lorenzo Porzi, Peter Kontschieder, Aljaž Božič, Dahua Lin, Michael Zollhöfer and Christian Richardt
SIGGRAPH Asia 2023

PyNeRF: Pyramidal Neural Radiance Fields
Haithem Turki, Michael Zollhöfer, Christian Richardt and Deva Ramanan
Advances in Neural Information Processing Systems (NeurIPS) 2023

Neural Feature Filtering for Faster Structure-from-Motion Localisation
Alexandros Rotsidis, Yuxin Wang, Yiorgos Chrysanthou and Christian Richardt
British Machine Vision Conference (BMVC) 2023

Neural Fields for Structured Lighting
Aarrushi Shandilya, Benjamin Attal, Christian Richardt, James Tompkin and Matthew O’Toole
International Conference on Computer Vision (ICCV) 2023

HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Sampling
Benjamin Attal, Jia-Bin Huang, Christian Richardt, Michael Zollhöfer, Johannes Kopf, Matthew O’Toole and Changil Kim
Conference on Computer Vision and Pattern Recognition (CVPR) 2023 (highlight, 2.6% acceptance rate)

Learning Neural Duplex Radiance Fields for Real-Time View Synthesis
Ziyu Wan, Christian Richardt, Aljaž Božič, Chao Li, Vijay Rengarajan, Seonghyeon Nam, Xiaoyu Xiang, Tuotuo Li, Bo Zhu, Rakesh Ranjan and Jing Liao
Conference on Computer Vision and Pattern Recognition (CVPR) 2023

2022

Egocentric Scene Reconstruction from an Omnidirectional Video
Hyeonjoong Jang, Andréas Meuleman, Dahyun Kang, Donggun Kim, Christian Richardt and Min H. Kim
ACM Transactions on Graphics (Proceedings of SIGGRAPH 2022)

360MonoDepth: High-Resolution 360° Monocular Depth Estimation
Manuel Rey-Area*, Mingze Yuan* and Christian Richardt
Conference on Computer Vision and Pattern Recognition (CVPR) 2022

2021

TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis
Benjamin Attal, Eliot Laidlaw, Aaron Gokaslan, Changil Kim, Christian Richardt, James Tompkin and Matthew O’Toole
Advances in Neural Information Processing Systems (NeurIPS) 2021

360° Optical Flow using Tangent Images
Mingze Yuan and Christian Richardt
British Machine Vision Conference (BMVC) 2021

Real-time Global Illumination Decomposition of Videos
Abhimitra Meka*, Mohammad Shafiei*, Michael Zollhöfer, Christian Richardt, and Christian Theobalt
ACM Transactions on Graphics 2021

ExMaps: Long-Term Localization in Dynamic Scenes using Exponential Decay
Alexandros Rotsidis, Christof Lutteroth, Peter Hall, and Christian Richardt
Winter Conference on Applications of Computer Vision (WACV) 2021

2020

OmniPhotos: Casual 360° VR Photography
Tobias Bertel, Mingze Yuan, Reuben Lindroos and Christian Richardt
ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2020)

Deferred Neural Rendering for View Extrapolation
Tobias Bertel, Yusuke Tomoto, Srinivas Rao, Rodrigo Ortiz-Cayon, Stefan Holzer and Christian Richardt
Poster at SIGGRAPH Asia 2020

Casual Real-World VR using Light Fields
Yusuke Tomoto, Srinivas Rao, Tobias Bertel, Krunal Chande, Christian Richardt, Stefan Holzer and Rodrigo Ortiz-Cayon
Poster at SIGGRAPH Asia 2020

Free-Viewpoint Facial Re-Enactment from a Casual Capture
Srinivas Rao, Rodrigo Ortiz-Cayon, Matteo Munaro, Aidas Liaudanskas, Krunal Chande, Tobias Bertel, Christian Richardt, Alexander J. B. Trevor, Stefan Holzer and Abhishek Kar
Poster at SIGGRAPH Asia 2020

BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Images
Thu Nguyen-Phuoc, Christian Richardt, Long Mai, Yong-Liang Yang and Niloy Mitra
Advances in Neural Information Processing Systems (NeurIPS) 2020

Photorealistic Audio-driven Video Portraits
Xin Wen, Miao Wang, Christian Richardt, Ze-Yin Chen and Shi-Min Hu
IEEE Transactions on Visualization and Computer Graphics (ISMAR 2020)

Transitioning360: Content-aware NFoV Virtual Camera Paths for 360° Video Playback
Miao Wang, Yi-Jun Li, Wen-Xuan Zhang, Christian Richardt and Shi-Min Hu
International Symposium on Mixed and Augmented Reality (ISMAR) 2020

MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images
Benjamin Attal, Selena Ling, Aaron Gokaslan, Christian Richardt and James Tompkin
European Conference on Computer Vision (ECCV) 2020 (oral presentation, 2.1% acceptance rate)

Combining Task Predictors via Enhancing Joint Predictability
Kwang In Kim, Christian Richardt and Hyung Jin Chang
European Conference on Computer Vision (ECCV) 2020

Capture, Reconstruction, and Representation of the Visual Real World for Virtual Reality
Christian Richardt, James Tompkin and Gordon Wetzstein
Book chapter in Real VR – Immersive Digital Reality, Springer 2020

Image-Based Scene Representations for Head-Motion Parallax in 360° Panoramas
Tobias Bertel, Feng Xu and Christian Richardt
Book chapter in Real VR – Immersive Digital Reality

Depth Augmented Omnidirectional Stereo for 6-DoF VR Photography
Tobias Bertel*, Moritz Mühlhausen*, Moritz Kappel, Paul M. Bittner, Christian Richardt and Marcus Magnor
Poster at IEEE VR 2020

Omnidirectional Stereo
Christian Richardt
In Computer Vision: A Reference Guide

2019

Neural Style-Preserving Visual Dubbing
Hyeongwoo Kim, Mohamed Elgharib, Michael Zollhöfer, Hans-Peter Seidel, Thabo Beeler, Christian Richardt and Christian Theobalt
ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2019)

Real-time Virtual Object Insertion for Moving 360° Videos
Joanna Tarko, James Tompkin and Christian Richardt
International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI 2019)

HoloGAN: Unsupervised learning of 3D representations from natural images
Thu Nguyen-Phuoc, Chuan Li, Lucas Theis, Christian Richardt and Yong-Liang Yang
International Conference on Computer Vision (ICCV) 2019

Capture4VR: From VR Photography to VR Video
Christian Richardt, Peter Hedman, Ryan S. Overbeck, Brian Cabral, Robert Konrad and Steve Sullivan
Course at SIGGRAPH 2019

Near-Eye Display and Tracking Technologies for Virtual and Augmented Reality
George Koulieris, Kaan Akşit, Michael Stengel, Rafał K. Mantiuk, Katerina Mania and Christian Richardt
Computer Graphics Forum (Eurographics 2019 State-of-the-Art Report)

MegaParallax: Casual 360° Panoramas with Motion Parallax
Tobias Bertel, Neill Campbell and Christian Richardt
IEEE Transactions on Visualization and Computer Graphics (IEEE VR 2019)

2018

MegaParallax: 360° Panoramas with Motion Parallax
Tobias Bertel, Neill Campbell and Christian Richardt
Short Paper at European Conference on Visual Media Production (CVMP) 2018
and Poster at SIGGRAPH 2018

Environment Reflections with 360° Videos using Omnidirectional Structure from Motion
Joanna Tarko and Christian Richardt
Short Paper at European Conference on Visual Media Production (CVMP) 2018

Cutting-Edge VR/AR Display Technologies
George Koulieris, Kaan Akşit, Christian Richardt, Rafał Mantiuk
Course at SIGGRAPH Asia 2018

Unsupervised Attention-Guided Image-to-Image Translation
Youssef Alami Mejjati, Christian Richardt, James Tompkin, Darren Cosker and Kwang In Kim
Advances in Neural Information Processing Systems (NeurIPS) 2018

Deep Video Portraits
Hyeongwoo Kim, Pablo Garrido, Ayush Tewari, Weipeng Xu, Justus Thies, Matthias Nießner, Patrick Pérez, Christian Richardt, Michael Zollhöfer and Christian Theobalt
ACM Transactions on Graphics (Proceedings of SIGGRAPH 2018)

LIME: Live Intrinsic Material Estimation
Abhimitra Meka, Maxim Maximov, Michael Zollhöfer, Avishek Chatterjee, Hans-Peter Seidel, Christian Richardt and Christian Theobalt
Conference on Computer Vision and Pattern Recognition (CVPR) 2018 (spotlight presentation)

InverseFaceNet: Deep Monocular Inverse Face Rendering
Hyeongwoo Kim, Michael Zollhöfer, Ayush Tewari, Justus Thies, Christian Richardt and Christian Theobalt
Conference on Computer Vision and Pattern Recognition (CVPR) 2018

Cutting-Edge VR/AR Display Technologies
George Koulieris, Kaan Akşit, Christian Richardt, Rafał Mantiuk and Katerina Mania
Tutorial at IEEE VR 2018

Parallax360: Stereoscopic 360° Scene Representation for Head-Motion Parallax
Bicheng Luo, Feng Xu, Christian Richardt and Jun-Hai Yong
IEEE Transactions on Visualization and Computer Graphics (IEEE VR 2018)

2017

Undoing Instagram Filters
Padraig Boulton and Christian Richardt
Short Paper at European Conference on Visual Media Production (CVMP) 2017

Dynamic Mixed-Reality Compositing with Unity
Joanna Tarko, Christian Richardt and Peter Hall
Short Paper at European Conference on Visual Media Production (CVMP) 2017

Predictor Combination at Test Time
Kwang In Kim, James Tompkin and Christian Richardt
International Conference on Computer Vision (ICCV) 2017

Live User-Guided Intrinsic Video For Static Scenes
Abhimitra Meka*, Gereon Fox*, Michael Zollhöfer, Christian Richardt and Christian Theobalt
IEEE Transactions on Visualization and Computer Graphics (ISMAR 2017)

Video for Virtual Reality
Christian Richardt, James Tompkin, Jordan Halsey, Aaron Hertzmann, Jonathan Starck and Oliver Wang
Course at SIGGRAPH 2017

 

2016

EgoCap: Egocentric Marker-less Motion Capture with Two Fisheye Cameras
Helge Rhodin, Christian Richardt, Dan Casas, Eldar Insafutdinov, Mohammad Shafiei, Hans-Peter Seidel, Bernt Schiele and Christian Theobalt
ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2016)

Dense Wide-Baseline Scene Flow From Two Handheld Video Cameras
Christian Richardt, Hyeongwoo Kim, Levi Valgaerts and Christian Theobalt
International Conference on 3D Vision 2016 (oral presentation, 9.8% acceptance rate)

Video Depth-From-Defocus
Hyeongwoo Kim, Christian Richardt and Christian Theobalt
International Conference on 3D Vision 2016

Real-time Halfway Domain Reconstruction of Motion and Geometry
Lucas Thies, Michael Zollhöfer, Christian Richardt, Christian Theobalt and Günther Greiner
International Conference on 3D Vision 2016

General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues
Helge Rhodin, Nadia Robertini, Dan Casas, Christian Richardt, Hans-Peter Seidel and Christian Theobalt
European Conference on Computer Vision (ECCV) 2016 (spotlight presentation, 2.9% acceptance rate)

Live Intrinsic Video
Abhimitra Meka, Michael Zollhöfer, Christian Richardt and Christian Theobalt
ACM Transactions on Graphics (Proceedings of SIGGRAPH 2016)

 

2015

A Versatile Scene Model with Differentiable Visibility Applied to Generative Pose Estimation
Helge Rhodin, Nadia Robertini, Christian Richardt, Hans-Peter Seidel and Christian Theobalt
International Conference on Computer Vision (ICCV) 2015

User-Centric Computational Videography
Christian Richardt, James Tompkin, Jiamin Bai and Christian Theobalt
Course at SIGGRAPH 2015

4D Model Flow: Precomputed Appearance Alignment for Real-time 4D Video Interpolation
Dan Casas, Christian Richardt, John Collomosse, Christian Theobalt and Adrian Hilton
Computer Graphics Forum (Proceedings of Pacific Graphics 2015)

 

2014

Temporally Coherent Video De-Anaglyph
Joan Sol Roo and Christian Richardt
Talk and Poster at SIGGRAPH 2014

Vectorising Bitmaps into Semi-Transparent Gradient Layers
Christian Richardt, Jorge Lopez-Moreno, Adrien Bousseau, Maneesh Agrawala and George Drettakis
Computer Graphics Forum (Proceedings of EGSR 2014)

 

2013

Perception of Perspective Distortions in Image-Based Rendering
Peter Vangorp, Christian Richardt, Emily A. Cooper, Gaurav Chaurasia, Martin S. Banks and George Drettakis
ACM Transactions on Graphics (Proceedings of SIGGRAPH 2013)

Megastereo: Constructing High-Resolution Stereo Panoramas
Christian Richardt, Yael Pritch, Henning Zimmer and Alexander Sorkine-Hornung
Proceedings of CVPR 2013 (oral presentation, 3.3% acceptance rate)

 

2012

Random Discrete Colour Sampling
Henrik Lieng, Christian Richardt and Neil A. Dodgson
Computational Aesthetics 2012

Coherent Spatiotemporal Filtering, Upsampling and Rendering of RGBZ Videos
Christian Richardt, Carsten Stoll, Neil A. Dodgson, Hans-Peter Seidel and Christian Theobalt
Computer Graphics Forum (Proceedings of Eurographics 2012)

 

2011

Layered Photo Pop-Up
Lech Świrski, Christian Richardt and Neil A. Dodgson
Poster at SIGGRAPH 2011
Winner of the ACM Student Research Competition

Predicting Stereoscopic Viewing Comfort Using a Coherence-Based Computational Model
Christian Richardt, Lech Świrski, Ian P. Davies and Neil A. Dodgson
Computational Aesthetics 2011

 

2010

Real-time Spatiotemporal Stereo Matching Using the Dual-Cross-Bilateral Grid
Christian Richardt, Douglas Orr, Ian Davies, Antonio Criminisi and Neil A. Dodgson
European Conference on Computer Vision (ECCV) 2010 (Poster + Demo)

Stereo Coherence in Watercolour Rendering
Christian Richardt, Jan Eric Kyprianidis and Neil A. Dodgson
Poster at Symposia on Computational Aesthetics, and on Non-Photorealistic Animation and Rendering 2010

 

2009

Real-Time Stereo Vision
Christian Richardt, Douglas Orr and Neil A. Dodgson
Poster at First UK CUDA Developers’ Conference 2009

Proteus – Semi-Automatic Interactive Structure-from-Motion
Malte Schwarzkopf and Christian Richardt
Poster at Vision, Modeling, and Visualization Workshop 2009

Voronoi Video Stylisation
Christian Richardt and Neil A. Dodgson
Computer Graphics International 2009 Short Papers

 

2008

Flash-Exposure High Dynamic Range Imaging: Virtual Photography and Depth-Compensating Flash
Christian Richardt
Technical Report UCAM-CL-TR-712, 2008, University of Cambridge Computer Laboratory