【Computational Photography】Udacity LESSON 3 01-03 Dual Photography

最新推荐文章于 2021-05-18 16:13:58 发布

我城一少年

最新推荐文章于 2021-05-18 16:13:58 发布

阅读量655

点赞数 3

分类专栏： Udacity notes 文章标签： computer vision

本文链接：https://blog.csdn.net/smiekickass/article/details/115243019

版权

Udacity notes 专栏收录该内容

7 篇文章 0 订阅

订阅专栏

春天的花是冬天的梦

Novel Illumination
在这里插入图片描述
Novel Camera

Dual Photography

Reflective Properties of Ray of Light

Stanford Dual Photography
See: http://graphics.stanford.edu/papers/dual_photography/

We present a novel photographic technique called dual photography, which exploits Helmholtz reciprocity to interchange the lights and cameras in a scene. With a video projector providing structured illumination, reciprocity permits us to generate pictures from the viewpoint of the projector, even though no camera was present at that location. The technique is completely image-based, requiring no knowledge of scene geometry or surface properties, and by its nature automatically includes all transport paths, including shadows, interreflections and caustics. In its simplest form, the technique can be used to take photographs without a camera; we demonstrate this by capturing a photograph using a projector and a photo-resistor. If the photo-resistor is replaced by a camera, we can produce a 4D dataset that allows for relighting with 2D incident illumination. Using an array of cameras we can produce a 6D slice of the 8D reflectance field that allows for relighting with arbitrary light fields. Since an array of cameras can operate in parallel without interference, whereas an array of light sources cannot, dual photography is fundamentally a more efficient way to capture such a 6D dataset than a system based on multiple projectors and one camera. As an example, we show how dual photography can be used to capture and relight scenes.
在这里插入图片描述
(a) Conventional photograph of a scene, illuminated by a projector with all its pixels turned on. (b) After measuring the light transport between the projector and the camera using structured illumination, our technique is able to synthesize a photorealistic image from the point of view of the projector. This image has the resolution of the projector and is illuminated by a light source at the position of the camera. The technique can capture subtle illumination effects such as caustics and self-shadowing. Note, for example, how the glass bottle in the primal image (a) appears as the caustic in the dual image (b) and vice-versa. Because we have determined the complete light transport between the projector and camera, it is easy to relight the dual image using a synthetic light source © or a light modified by a matte captured later by the same camera (d).