Improving a gradient based algorithm using the momentum term
There are a number of algorithms that can be categorized as gradient based. One such algorithm is the Dynamic Integrated Systems Optimization and Parameter Estimation algorithm meant for solving nonlinear optimal control problems. A common trait to gradient based algorithms is that their search dir...
Saved in:
Main Author: | |
---|---|
Format: | Book Section |
Published: |
Penerbit UTM
2007
|
Subjects: | |
Online Access: | http://eprints.utm.my/id/eprint/13497/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my.utm.13497 |
---|---|
record_format |
eprints |
spelling |
my.utm.134972011-08-09T01:05:23Z http://eprints.utm.my/id/eprint/13497/ Improving a gradient based algorithm using the momentum term Ahmad, Rohainin Q Science (General) There are a number of algorithms that can be categorized as gradient based. One such algorithm is the Dynamic Integrated Systems Optimization and Parameter Estimation algorithm meant for solving nonlinear optimal control problems. A common trait to gradient based algorithms is that their search direction is determined by the gradient vector of the objective function. One peculiar behavior of gradient based searches is that any two consecutive directions would be perpendicular to each other. Because of this, the path of the search will zigzag towards the optimal solution. The zigzag movement of the search is associated with the unfavorable e?ect of slowing down the algorithms especially when the surface of the function is in the form of ravines. This chapter proposed the use of momentum term to append the search mechanism of said algorithm in order to overcome this zigzag problem. In our simulation we found that the momentum term managed to decrease the number of iterations needed by this algorithm to arrive at the optimum Penerbit UTM 2007 Book Section PeerReviewed Ahmad, Rohainin (2007) Improving a gradient based algorithm using the momentum term. In: Recent Advances In Theoretical and Numerical Methods. Penerbit UTM, Johor, pp. 81-92. ISBN 978-983-52-0610-8 |
institution |
Universiti Teknologi Malaysia |
building |
UTM Library |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
Universiti Teknologi Malaysia |
content_source |
UTM Institutional Repository |
url_provider |
http://eprints.utm.my/ |
topic |
Q Science (General) |
spellingShingle |
Q Science (General) Ahmad, Rohainin Improving a gradient based algorithm using the momentum term |
description |
There are a number of algorithms that can be categorized as gradient based. One such algorithm is the Dynamic Integrated Systems Optimization and Parameter Estimation algorithm meant for solving nonlinear optimal control problems. A common trait to gradient based algorithms is that their search direction is determined by the gradient vector of the objective function. One peculiar behavior of gradient based searches is that any two consecutive directions would be perpendicular to each other. Because of this, the path of the search will zigzag towards the optimal solution. The zigzag movement of the search is associated with the unfavorable e?ect of slowing down the algorithms especially when the surface of the function is in the form of ravines. This chapter proposed the use of momentum term to append the search mechanism of said algorithm in order to overcome this zigzag problem. In our simulation we found that the momentum term managed to decrease the number of iterations needed by this algorithm to arrive at the optimum |
format |
Book Section |
author |
Ahmad, Rohainin |
author_facet |
Ahmad, Rohainin |
author_sort |
Ahmad, Rohainin |
title |
Improving a gradient based algorithm using the momentum term |
title_short |
Improving a gradient based algorithm using the momentum term |
title_full |
Improving a gradient based algorithm using the momentum term |
title_fullStr |
Improving a gradient based algorithm using the momentum term |
title_full_unstemmed |
Improving a gradient based algorithm using the momentum term |
title_sort |
improving a gradient based algorithm using the momentum term |
publisher |
Penerbit UTM |
publishDate |
2007 |
url |
http://eprints.utm.my/id/eprint/13497/ |
_version_ |
1643646205547249664 |
score |
13.160551 |