Funded by the European Union. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or the European Education and Culture Executive Agency (EACEA). Neither the European Union nor EACEA can be held responsible for them.

Algorithms

Levenberg-Marquardt algorithm

Users: 1 - Average Rating: 5.00


In mathematics and computing, the Levenberg–Marquardt algorithm (LMA or just LM), also known as the damped least-squares (DLS) method, is used to solve non-linear least squares problems. These minimization problems arise especially in least squares curve fitting. This means that in fact, the method is also a learning method to fit curves to data. The LMA interpolates between the Gauss–Newton algorithm (GNA) and the method of gradient descent. The LMA is more robust than the GNA, which means that in many cases it finds a solution even if it starts very far off the final minimum. For well-behaved functions and reasonable starting parameters, the LMA tends to be slower than the GNA.

Scientific Area:
MatLab, Python, R

Language/Environments:
Optimization

Target Group:
Basic


Cite as:
Levenberg, Kenneth (1944). "A Method for the Solution of Certain Non-Linear Problems in Least Squares". Quarterly of Applied Mathematics. 2 (2): 164–168. doi:10.1090/qam/10666.
Marquardt, Donald (1963). "An Algorithm for Least-Squares Estimation of Nonlinear Parameters". SIAM Journal on Applied Mathematics. 11 (2): 431–441. doi:10.1137/0111030. hdl:10338.dmlcz/104299.

Author of the review:
Eligius Hendrix
University of Malaga


Reviews

You have to login to leave a comment. If you are not registered click here

Pablo Guerrero-Garcia


Some remarks on the difference between Levenberg and Marquardt approaches can be found at http://web.archive.org/web/20140301154319/http://www3.villanova.edu/maple/misc/mtc1093.html