【Stokes Vector】Stokes向量的计算以及模拟偏振的插值

Interpolating Polarization From DoFP Using Stokes Vector

2023-7-4 10:33:26

Polarization plays an important role in both industry and research. By using the different polarization properties, we could eliminate the highlight on the object’s surface, or detect the stress on it¹. Some polarized camera sensors are manufactured, to cater for those applications. For example, division of time(DoT), division of amplitude(DoAM), division of aperture(DoAP) and recently, division of focal plane polarimeters(DoFP)².

DoFP imaging sensors are compact and non-moving, which could capture polarized images in a snapshot. Sony IMX250MYR CMOS sensors are well-designed DoFP devices, which embed on-chip polarizers of different polarization angles for each pixel(Figure), but not on-glass polarizers, to reduce the crosstalk of polarized light.

In clockwise, the polarizers on IMX250MYR CMOS from left bottom to right bottom pixels are $135^{\circ }$, $90^{\circ }$, $45^{\circ }$, $0^{\circ }$, and four polarized photodiodes constitute a colour sensor module and four colour sensor modules constitute a colour pixel, which obeys the Bayer rule, is RGGB. After one shot using IMX250MYR, we could get a full-resolution Bayer image, and each Bayer pixel consists of four polarized responses, hence we could decompose the Bayer image into four half-resolution polarized images of each polarization angle. In recent years, many researchers worked so hard, aim to solve the problem of demosaicking the polarized sensor, because they want to fully use the resolution of the DoFP, but the response intensity of no-polarization at each pixel position is difficult to estimate.³ If we just use the polarized half-resolution image, we may not need to care about the demosaicking problem. However, in many scenarios, we may need to generate a virtual polarization filter. Before illustrating how to do that, we should know about the Stokes vector.

Stokes vector with Stokes parameters is a set of values that describe the polarization state(Wiki). The Stokes vector $S$ can be defined as $S(I,Q,U,V)$, where $I$ is the total intensity of four polarized responses, $Q$ and $U$ present the linear polarization, while $V$ presents the circular polarization state. In this case we only consider the linear polarization:
$$\begin{array}{rl}& S=\left[\begin{array}{c}I\\ Q\\ C\end{array}\right]=\left[\begin{array}{c}{S}_0\\ S_1\\ S_2\end{array}\right]=\left[\begin{array}{c}\frac{1}{2}(I_0+I_{45}+I_{90}+I_{135})\\ I_0-I_{90}\\ I_{45}-I_{135}\end{array}\right]=\left[\begin{array}{c}{I}_{tot}\\ I_{tot}\mathcal{P}\cos (2\varphi )\\ I_{tot}\mathcal{P}\sin (2\varphi )\end{array}\right]\end{array}$$
Also, the we can use matrix to transform intensity to Stokes vector:
$$\begin{array}{rl}& S=\left[\begin{array}{c}{S}_0\\ S_1\\ S_2\end{array}\right]=\left[\begin{array}{cccc}\frac{1}{2}& \frac{1}{2}& \frac{1}{2}& \frac{1}{2}\\ 1& 0& -1& 0\\ 0& 1& 0& -1\end{array}\right]\left[\begin{array}{c}{I}_0\\ I_{45}\\ I_{90}\\ I_{135}\end{array}\right]\end{array}$$
Where $\mathcal{P}$ and $\varphi$ are Degree of Linear Polarization(DoLP) and Angle of Linear Polarization(AoLP), which defined as:
$$\begin{array}{rl}& \mathcal{P}=\frac{\sqrt{S_1^2+S_2^2}}{S_0},\varphi =\frac{1}{2}\arctan (\frac{S_2}{S_1})\end{array}$$
For the intensity of an arbitrary angle of polarization, we could use Müller matrix to interpolate, that is:
$$\begin{array}{rl}& S_{\theta }=\left[\begin{array}{c}{I}_{tot,\theta }\\ I_{tot,\theta }\mathcal{P}\cos (2\varphi )\\ I_{tot,\theta }\mathcal{P}\sin (2\varphi )\end{array}\right]=M_{\theta }S=\frac{1}{2}\left[\begin{array}{ccc}1& \cos (2\theta )& \sin (2\theta )\\ \cos (2\theta )& {\cos }^2(2\theta )& \sin (2\theta )\cos (2\theta )\\ \sin (2\theta )& \sin (2\theta )\cos (2\theta )& {\sin }^2(2\theta )\end{array}\right]\left[\begin{array}{c}\frac{1}{2}(I_0+I_{45}+I_{90}+I_{135})\\ I_0-I_{90}\\ I_{45}-I_{135}\end{array}\right]\end{array}$$
The intensity we need it the first term of Stokes vector of tarthe get polarization angle, $I_{tot,\theta }$. As definition, the Müller matrices for $135^{\circ }$, $90^{\circ }$, $45^{\circ }$, $0^{\circ }$ are:

$$\begin{array}{rl}& \{\begin{array}{cc}{M}_0=\frac{1}{2}\left[\begin{array}{ccc}1& 1& 0\\ 1& 1& 0\\ 0& 0& 0\end{array}\right],& M_{90}=\frac{1}{2}\left[\begin{array}{ccc}1& -1& 0\\ -1& 1& 0\\ 0& 0& 0\end{array}\right]\\ M_{45}=\frac{1}{2}\left[\begin{array}{ccc}1& 0& 1\\ 0& 0& 0\\ 1& 0& 1\end{array}\right],& M_{135}=\frac{1}{2}\left[\begin{array}{ccc}1& 0& -1\\ 0& 0& 0\\ -1& 0& 1\end{array}\right]\end{array}\end{array}$$

However, this is only in the ideal occasion. In such conditions, the cross-polarized light could be completely blocked. In reality, the polarizers usually are imperfect due to manufacture. The parallel and perpendicular transmittance become $k_1$ and $k_2$, then diattenuation is $D=(k_1+k_2)/(k_1-k_2)$, and extinction ratio is $ER=k_1/k_2=(D+1)/(D-1)$³, and the imperfect Müller matrix become:
$$\begin{array}{rl}& M_{\theta }=\frac{1}{2}\left[\begin{array}{ccc}{k}_1+k_2& (k_1-k_2)\cos (2\theta )& (k_1-k_2)\sin (2\theta )\\ (k_1-k_2)\cos (2\theta )& (k_1+k_2){\cos }^2(2\theta )+2\sqrt{k_1{k}_2}{\sin }^2(2\theta )& (k_1+k_2-2\sqrt{k_1{k}_2})\sin (2\theta )\cos (2\theta )\\ (k_1-k_2)\sin (2\theta )& (k_1+k_2-2\sqrt{k_1{k}_2})\sin (2\theta )\cos (2\theta )& (k_1+k_2){\sin }^2(2\theta )+2\sqrt{k_1{k}_2}{\cos }^2(2\theta )\end{array}\right]\end{array}$$

Code Example:

def PolarInterp_Stokes(angle):
    anlge_rec = angle/180 * np.pi
    height = polar_0.shape[0]
    width = polar_0.shape[1]
    
    polar_0_vec = np.double(np.reshape(polar_0, (1, height*width)))
    polar_45_vec = np.double(np.reshape(polar_45, (1, height*width)))
    polar_90_vec = np.double(np.reshape(polar_90, (1, height*width)))
    polar_135_vec = np.double(np.reshape(polar_135, (1, height*width)))
    
    S = np.zeros((3, height*width))
    S[0, :] = (1/2)*(polar_0_vec + polar_45_vec + polar_90_vec + polar_135_vec)
    S[1, :] =  polar_0_vec - polar_90_vec
    S[2, :] = polar_45_vec - polar_135_vec
    
    M_angle = np.zeros((3, 3))
    M_angle[0, 0] = 1; 
    M_angle[0, 1] = np.cos(2*anlge_rec) 
    M_angle[0, 2] = np.sin(2*anlge_rec) 
    M_angle[1, 0] = np.cos(2*anlge_rec) 
    M_angle[1, 1] = np.cos(2*anlge_rec) * np.cos(2*anlge_rec)
    M_angle[1, 2] = np.sin(2*anlge_rec) * np.cos(2*anlge_rec)
    M_angle[2, 0] = np.sin(2*anlge_rec)
    M_angle[2, 1] = np.sin(2*anlge_rec) * np.cos(2*anlge_rec)
    M_angle[2, 2] = np.sin(2*anlge_rec) * np.sin(2*anlge_rec)
    M_angle = (1/2)*M_angle
    
    S_angle = np.double(np.matmul(M_angle, S))
    S_angle[0,:][S_angle[0,:]<0] = 0
    S_angle[0,:][S_angle[0,:]>255] = 255
    Image_angle = np.uint8(np.reshape(S_angle[0, :], (height, width)))
    return Image_angle

Result(Cross polarization, Polarization angle from 0~180):

References

---

1. chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/https://dce9ugryut4ao.cloudfront.net/LUCID-Going-Polarized-White-Paper.pdf ↩︎

2. Zhang J, Luo H, Hui B, et al. Image interpolation for division of focal plane polarimeters with intensity correlation[J]. Optics express, 2016, 24(18): 20799-20807. ↩︎

3. Qiu S, Fu Q, Wang C, et al. Linear polarization demosaicking for monochrome and colour polarization focal plane arrays[C]//Computer Graphics Forum. 2021, 40(6): 77-89. ↩︎ ↩︎