Plenoptic cameras

The light field, as defined by Gershun in 1936 [Gershun 36] describes the radiance traveling in every direction through every point in space. Mathematically, it can be described by a 5D function which is called the plenoptic function, in more generality sometimes given with the two additional dimensions time and wavelength. Outside a scene, in the absence of occluders, however, light intensity does not change while traveling along a ray. Thus, the light field of a scene can be parameterized over a surrounding surface; light intensity is attributed to every ray passing through the surface into any direction. This yields the common definition of the light field as a 4D function. In contrast, a single pinhole view of the scene only captures the rays passing through the center of projection, corresponding to a single 2D cut through the light field. Fortunately, camera sensors have made tremendous progress and nowadays offer extremely high resolutions. For many visual-computing applications, however, spatial resolution is already more than sufficient, while robustness of the results is what really matters. Computational photography explores methods to use the extra resolution in different ways. In particular, it is possible to capture several views of a scene from slightly different directions on a single sensor and thus offer single-shot 4D light field capture. Technically, this capture can be realized by a so-called plenoptic camera, which uses an array of microlenses mounted in front of the sensor [Ng 06]. This type of camera offers interesting opportunities for the design of visual computing algorithms, and it has been predicted that it will play an important role in the consumer market of the future.

@InCollection { GKWE15,
  author       = "Goldlucke, B. and Klehm, Oliver and Wanner, S. and Eisemann, Elmar",
  title        = "Plenoptic cameras",
  booktitle    = "Digital Representations of the Real World: How to Capture, Model, and Render Visual Reality",
  chapter      = "5",
  year         = "2015",
  editor       = "Magnor, Marcus A. and Grau, Oliver and Sorkine-Hornung, Olga and Theobalt, Christian",
  publisher    = "A K Peters/CRC Press",
  edition      = "1",
  note         = "http://www.crcpress.com/product/isbn/9781482243819",
  url          = "http://graphics.tudelft.nl/Publications-new/2015/GKWE15"
}