几种范数的解释 l0-Norm, l1-Norm, l2-Norm, … , l-infinity Norm
I’m working on things related to norm a lot lately and it is time to talk about it. In this post we are going to discuss about a whole family of norm.
What is a norm?
Mathematically a norm is a total size or length of all vectors in a vector space or matrices. For simplicity, we can say that the higher the norm is, the bigger the (value in) matrix or vector is. Norm may come in many forms and many names, including these popular name: Euclidean distance, Mean-squared Error, etc.
Most of the time you will see the norm appears in a equation like this:
where can be a vector or a matrix.
For example, a Euclidean norm of a vector is which is the size of vector
The above example shows how to compute a Euclidean norm, or formally called an -norm. There are many other types of norm that beyond our explanation here, actually for every single real number, there is a norm correspond to it (Notice the emphasised word real number, that means it not limited to only integer.)
Formally the -norm of is defined as:
where
That’s it! A p-th-root of a summation of all elements to the p-th power is what we call a norm.
The interesting point is even though every -norm is all look very similar to each other, their mathematical properties are very different and thus their application are dramatically different too. Hereby we are going to look into some of these norms in details.
l0-norm
The first norm we are going to discuss is a -norm. By definition, -norm of is
Strictly speaking, -norm is not actually a norm. It is a cardinality function which has its definition in the form of -norm, though many people call it a norm. It is a bit tricky to work with because there is a presence of zeroth-power and zeroth-root in it. Obviously any will become one, but the problems of the definition of zeroth-power and especially zeroth-root is messing things around here. So in reality, most mathematicians and engineers use this definition of -norm instead: