LM算法全称为Levenberg-Marquard algorithm,在正式介绍该算法之前,我们需要先研读一下对该算法的发展有重要意义的几篇论文。首先,我们从LM算法的开篇之作(Levenberg于1944年发表)开始。
A method for the solution of certain non-linear problems in least squares
------------------------------------------------------------------------------------------------------------
引言部分:
The standard method for solving least squares problems which lead to non-linear normal equations depends upon a reduction of the residuals to linear form by first order Taylor approximations taken about an initial or trial solution for the parameters. If the usual least squares procedure, performed with these linear approximations, yields new values for the parameters which are