max planck institut informatik
mpii logo Minerva of the Max Planck Society

Light-Field Intrinsic Dataset, BMVC 2018


Light-Field Intrinsic Dataset

Sumit Shekhar*1     Shida Beigpour*1     Matthias Ziegler3     Michał Chwesiuk4     Dawid Paleń4     Karol Myszkowski1    
Joachim Keinert3     Radosław Mantiuk4     Piotr Didyk1,2,5    

1 MPI Informatik     2 MMCI, Saarland University      3 Fraunhofer IIS    
4 West Pomeranian University of Technology     5 Università della Svizzera italiana    

* indicates equal contribution

Abstract

Light-field imaging has various advantages over the traditional 2D photography, such as depth estimation and occlusion detection, which can aid intrinsic decomposition. The extracted intrinsic layers enable multiple applications, such as light-field appearance editing. However, the current light-field intrinsic decomposition techniques primarily resort to qualitative comparisons, due to lack of ground-truth data. In this work, we address this problem by providing intrinsic dataset for real world and synthetic 4D and 3D (only horizontal parallax) light fields. The ground-truth intrinsic data comprises albedo, shading and specularity layers for all sub-aperture images. In case of synthetic data, we also provide ground-truth depth, normals, and further decomposition of shading into direct and indirect components. For real-world data acquisition, we make use of custom hardware and 3D printed objects, assuring precision during multi-pass capturing. We also perform, qualitative and quantitative, comparison of existing intrinsic decomposition algorithms for single image, video, and light field. To the best of our knowledge, this is the first such dataset for light fields, which is also applicable for single image, multi-view stereo, and video.

Results



  1. Synthetic Dense Light-Field Intrinsics


  2. Synthetic Sparse Light-Field Intrinsics


  3. Real-world 3D Light-Field Intrinsics


  4. Real-world 4D Light-Field Intrinsics



Citation

Sumit Shekhar, Shida Beigpour, Matthias Ziegler, Michał Chwesiuk, Dawid Paleń, Karol Myszkowski, Joachim Keinert, Radosław Mantiuk, Piotr Didyk
Light-Field Intrinsic Dataset
British Machine Vision Conference (BMVC), 2018


@inproceedings{Shekhar2018,
 author = {Sumit Shekhar and Shida Beigpour and Matthias Ziegler and Michał Chwesiuk and Dawid Paleń and Karol Myszkowski 
and Joachim Keinert and Radosław Mantiuk and Piotr Didyk }, booktitle = {British Machine Vision Conference (BMVC), 2018}, title = {Light-Field Intrinsic Dataset}, pages = {120}, publisher = {{BMVA} Press}, year = {2018} }

© 2018 The Authors. This is the author's version of the work. It is posted here for your personal use. Not for redistribution.

Downloads

Paper (Full Author's Copy) (16.4 MB)
Supplementary material (22.9 MB)
Synthetic Datasets
Real-World Datasets coming soon...

Related Projects


  1. Towards a Quality Metric for Dense Light Fields

  2. Efficient Multi-image Correspondences for On-line Light Field Video Processing

  3. Light-Field Appearance Editing Based on Intrinsic Decomposition

Acknowledgements

We would like to thank Michal Piovarči for his help with the 3D printing. We would like to thank Anna Alperovich and Ole Johansen for valuable discussion. We would like to thank Anna Alperovich, Abhimitra Meka, and Elena Garces for kindly providing the necessary comparisons. We thank the reviewers for their insightful comments. The project was supported by the Fraunhofer and Max Planck cooperation program within the German pact for research and innovation (PFI).

MPI Informatik Saarland University MMCI, Saarland University West Pomeranian University of Technology, Szczecin, Poland Università della Svizzera italiana, Lugano, Switzerland Fraunhofer IIS