AI-图像不变矩-图像识别的数学基础

最新推荐文章于 2022-11-07 10:59:40 发布

置顶 Leemboy

最新推荐文章于 2022-11-07 10:59:40 发布

阅读量1.2k

点赞数

AI基础-图像不变矩

In image processing, computer vision and related fields, an image moment is a certain particular weighted average (moment) of the image pixels' intensities, or a function of such moments, usually chosen to have some attractive property or interpretation.

Image moments are useful to describe objects after segmentation. Simple properties of the image which are found via image moments include area (or total intensity), its centroid, and information about its orientation.

Raw moments

For a 2D continuous function f(x,y) the moment (sometimes called "raw moment") of order (p + q) is defined as

M_{​{pq}}=\int \limits _{​{-\infty }}^{​{\infty }}\int \limits _{​{-\infty }}^{​{\infty }}x^{p}y^{q}f(x,y)\,dx\,dy

for p,q = 0,1,2,... Adapting this to scalar (greyscale) image with pixel intensities I(x,y), raw image moments M_ij are calculated by

M_{​{ij}}=\sum _{x}\sum _{y}x^{i}y^{j}I(x,y)\,\!

In some cases, this may be calculated by considering the image as a probability density function, i.e., by dividing the above by

\sum _{x}\sum _{y}I(x,y)\,\!

A uniqueness theorem (Hu [1962]) states that if f(x,y) is piecewise continuous and has nonzero values only in a finite part of the xy plane, moments of all orders exist, and the moment sequence (M_pq) is uniquely determined by f(x,y). Conversely, (M_pq) uniquely determines f(x,y). In practice, the image is summarized with functions of a few lower order moments.

Examples

Simple image properties derived via raw moments include:

Area (for binary images) or sum of grey level (for greytone images): M₀₀
Centroid: { x, y } = {M₁₀/M₀₀, M₀₁/M₀₀ }

Central moments

Central moments are defined as

\mu _{​{pq}}=\int \limits _{​{-\infty }}^{​{\infty }}\int \limits _{​{-\infty }}^{​{\infty }}(x-{\bar {x}})^{p}(y-{\bar {y}})^{q}f(x,y)\,dx\,dy

where ${\bar {x}}={\frac {M_{{10}}}{M_{{00}}}}$ and ${\bar {y}}={\frac {M_{{01}}}{M_{{00}}}}$ are the components of the centroid.

If ƒ(x, y) is a digital image, then the previous equation becomes

\mu _{​{pq}}=\sum _{​{x}}\sum _{​{y}}(x-{\bar {x}})^{p}(y-{\bar {y}})^{q}f(x,y)

The central moments of order up to 3 are:

\mu _{​{00}}=M_{​{00}},\,\!

\mu _{​{01}}=0,\,\!

\mu _{​{10}}=0,\,\!

\mu _{​{11}}=M_{​{11}}-{\bar {x}}M_{​{01}}=M_{​{11}}-{\bar {y}}M_{​{10}},

\mu _{20}=M_{20}-{\bar {x}}M_{10},

\mu _{02}=M_{02}-{\bar {y}}M_{01},

\mu _{​{21}}=M_{​{21}}-2{\bar {x}}M_{​{11}}-{\bar {y}}M_{​{20}}+2{\bar {x}}^{2}M_{​{01}},

\mu _{​{12}}=M_{​{12}}-2{\bar {y}}M_{​{11}}-{\bar {x}}M_{​{02}}+2{\bar {y}}^{2}M_{​{10}},

\mu _{​{30}}=M_{​{30}}-3{\bar {x}}M_{​{20}}+2{\bar {x}}^{2}M_{​{10}},

\mu _{​{03}}=M_{​{03}}-3{\bar {y}}M_{​{02}}+2{\bar {y}}^{2}M_{​{01}}.

It can be shown that:

\mu _{​{pq}}=\sum _{​{m}}^{p}\sum _{​{n}}^{q}{p \choose m}{q \choose n}(-{\bar {x}})^{​{(p-m)}}(-{\bar {y}})^{​{(q-n)}}M_{​{mn}}

Central moments are translational invariant.

Examples

Information about image orientation can be derived by first using the second order central moments to construct a covariance matrix.

\mu '_{​{20}}=\mu _{​{20}}/\mu _{​{00}}=M_{​{20}}/M_{​{00}}-{\bar {x}}^{2}

\mu '_{​{02}}=\mu _{​{02}}/\mu _{​{00}}=M_{​{02}}/M_{​{00}}-{\bar {y}}^{2}

\mu '_{​{11}}=\mu _{​{11}}/\mu _{​{00}}=M_{​{11}}/M_{​{00}}-{\bar {x}}{\bar {y}}

The covariance matrix of the image $I(x,y)$ is now

\operatorname {cov}[I(x,y)]={\begin{bmatrix}\mu '_{​{20}}&\mu '_{​{11}}\\\mu '_{​{11}}&\mu '_{​{02}}\end{bmatrix}}

The eigenvectors of this matrix correspond to the major and minor axes of the image intensity, so the orientation can thus be extracted from the angle of the eigenvector associated with the largest eigenvalue towards the axis closest to this eigenvector. It can be shown that this angle Θ is given by the following formula:

\Theta ={\frac {1}{2}}\arctan \left({\frac {2\mu '_{​{11}}}{\mu '_{​{20}}-\mu '_{​{02}}}}\right)

The above formula holds as long as:

\mu '_{​{20}}-\mu '_{​{02}}\neq 0

The eigenvalues of the covariance matrix can easily be shown to be

\lambda _{i}={\frac {\mu '_{​{20}}+\mu '_{​{02}}}{2}}\pm {\frac {​{\sqrt {4{\mu '}_{​{11}}^{2}+({\mu '}_{​{20}}-{\mu '}_{​{02}})^{2}}}}{2}},

and are proportional to the squared length of the eigenvector axes. The relative difference in magnitude of the eigenvalues are thus an indication of the eccentricity of the image, or how elongated it is. The eccentricity is

{\sqrt {1-{\frac {\lambda _{2}}{\lambda _{1}}}}}.

Moment invariants

Moments are well-known for their application in image analysis, since they can be used to derive invariants with respect to specific transformation classes.

The term invariant moments is often abused in this context. However, while moment invariants are invariants that are formed from moments, the only moments that are invariants themselves are the central moments.

Note that the invariants detailed below are exactly invariant only in the continuous domain. In a discrete domain, neither scaling nor rotation are well defined: a discrete image transformed in such a way is generally an approximation, and the transformation is not reversible. These invariants therefore are only approximately invariant when describing a shape in a discrete image.

Translation invariants

The central moments μ_{i j} of any order are, by construction, invariant with respect to translations.

Scale invariants

Invariants η_{i j} with respect to both translation and scale can be constructed from central moments by dividing through a properly scaled zero-th central moment:

\eta _{​{ij}}={\frac {\mu _{​{ij}}}{\mu _{​{00}}^{​{\left(1+{\frac {i+j}{2}}\right)}}}}\,\!

where i + j ≥ 2. Note that translational invariance directly follows by only using central moments.

Rotation invariants

As shown in the work of Hu et al., invariants with respect to translation, scale, and rotation can be constructed:

$I_{1}=\eta _{{20}}+\eta _{{02}}$

$I_{2}=(\eta _{{20}}-\eta _{{02}})^{2}+4\eta _{{11}}^{2}$

$I_{3}=(\eta _{{30}}-3\eta _{{12}})^{2}+(3\eta _{{21}}-\eta _{{03}})^{2}$

$I_{4}=(\eta _{{30}}+\eta _{{12}})^{2}+(\eta _{{21}}+\eta _{{03}})^{2}$

$I_{5}=(\eta _{{30}}-3\eta _{{12}})(\eta _{{30}}+\eta _{{12}})[(\eta _{{30}}+\eta _{{12}})^{2}-3(\eta _{{21}}+\eta _{{03}})^{2}]+(3\eta _{{21}}-\eta _{{03}})(\eta _{{21}}+\eta _{{03}})[3(\eta _{{30}}+\eta _{{12}})^{2}-(\eta _{{21}}+\eta _{{03}})^{2}]$

$I_{6}=(\eta _{{20}}-\eta _{{02}})[(\eta _{{30}}+\eta _{{12}})^{2}-(\eta _{{21}}+\eta _{{03}})^{2}]+4\eta _{{11}}(\eta _{{30}}+\eta _{{12}})(\eta _{{21}}+\eta _{{03}})$

$I_{7}=(3\eta _{{21}}-\eta _{{03}})(\eta _{{30}}+\eta _{{12}})[(\eta _{{30}}+\eta _{{12}})^{2}-3(\eta _{{21}}+\eta _{{03}})^{2}]-(\eta _{{30}}-3\eta _{{12}})(\eta _{{21}}+\eta _{{03}})[3(\eta _{{30}}+\eta _{{12}})^{2}-(\eta _{{21}}+\eta _{{03}})^{2}].$

These are well-known as Hu moment invariants.

The first one, I₁, is analogous to the moment of inertia around the image's centroid, where the pixels' intensities are analogous to physical density. The last one, I₇, is skew invariant, which enables it to distinguish mirror images of otherwise identical images.

A general theory on deriving complete and independent sets of rotation moment invariants was proposed by J. Flusser. He showed that the traditional set of Hu moment invariants is not independent nor complete. I₃ is not very useful as it is dependent on the others. In the original Hu's set there is a missing third order independent moment invariant:

I_{8}=\eta _{​{11}}[(\eta _{​{30}}+\eta _{​{12}})^{2}-(\eta _{​{03}}+\eta _{​{21}})^{2}]-(\eta _{​{20}}-\eta _{​{02}})(\eta _{​{30}}+\eta _{​{12}})(\eta _{​{03}}+\eta _{​{21}})

Later, J. Flusser and T. Suk specialized the theory for N-rotationally symmetric shapes case.

Hu moment invariants to solve the Pathological Brain Detection (PBD) problem.

Leemboy

关注

0
点赞
踩
0

收藏

觉得还不错? 一键收藏
0
评论
AI-图像不变矩-图像识别的数学基础

AI基础-图像不变矩 In image processing, computer vision and related fields, an image moment is a certain particular weighted average (moment) of the image pixels' intensities, or a function of
复制链接

扫一扫