光场相机 light field camera

EPINET: A Fully-Convolutional Neural Network Using Epipolar Geometry for Depth from Light Field Images

Light field cameras能够同时捕捉空间中光的位置属性和角度属性。

根据Levoy的广场渲染理论，空间中携带强度和方向信息的任何光线，都可以用两个平行的平面参数化表示，光线与两个平面相交于两点，形成四维函数L(u，v，x，y)，光场成像是一个(x,y)成像网格，每幅图像表明到达成像面某个微透镜的光线来自主镜头不同的(u,v)位置。

 

Light field cameras capture both the spatial and the angular properties of light rays in space. Due to its property, one can compute the depth from light fields in uncontrolled lighting environments, which is a big advantage over active sensing devices. Depth computed from light fields can be used for many applications including 3D modelling and refocusing. However, light field images from hand-held cameras have very narrow baselines with noise, making the depth estimation difficult. Many approaches have been proposed to overcome these limitations for the light field depth estimation, but there is a clear trade-off between the accuracy and the speed in these methods. In this paper, we introduce a fast and accurate light field depth estimation method based on a fully-convolutional neural network. Our network is designed by considering the light field geometry and we also overcome the lack of training data by proposing light field specific data augmentation methods. We achieved the top rank in the HCI 4D Light Field Benchmark on most metrics, and we also demonstrate the effectiveness of the proposed method on real-world light-field images.