Advances of metaheuristic algorithms in training neural networks for industrial applications
Backpropagation; Gradient methods; Neural networks; Artificial neural network models; Complex applications; Exploration and exploitation; Gradient-based learning; Industry applications; Meta heuristic algorithm; Meta-heuristic search algorithms; Near-optimal solutions; Optimization
Saved in:
| Main Authors: | , , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Published: |
Springer Science and Business Media Deutschland GmbH
2023
|
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| id |
my.uniten.dspace-26073 |
|---|---|
| record_format |
dspace |
| spelling |
my.uniten.dspace-260732023-05-29T17:06:34Z Advances of metaheuristic algorithms in training neural networks for industrial applications Chong H.Y. Yap H.J. Tan S.C. Yap K.S. Wong S.Y. 55654589300 35319362200 7403366395 24448864400 55812054100 Backpropagation; Gradient methods; Neural networks; Artificial neural network models; Complex applications; Exploration and exploitation; Gradient-based learning; Industry applications; Meta heuristic algorithm; Meta-heuristic search algorithms; Near-optimal solutions; Optimization In recent decades, researches on optimizing the parameter of the artificial neural network (ANN) model has attracted significant attention from researchers. Hybridization of superior algorithms helps improving optimization performance and capable of solving complex applications. As a traditional gradient-based learning algorithm, ANN suffers from a slow learning rate and is easily trapped in local minima when training techniques such as gradient descent (GD) and back-propagation (BP) algorithm are used. The characteristics of randomization and selection of the best or near-optimal solution of metaheuristic algorithm provide an effective and robust solution; therefore, it has always been used in training of ANN to improve and overcome the above problems. New metaheuristic algorithms are proposed every year. Therefore, the review of its latest developments is essential. This article attempts to summarize the metaheuristic algorithms which have been proposed from the year 1975 to 2020 from various journals, conferences, technical papers, and books. The comparison of the popularity of the metaheuristic algorithm is presented in two time frames, such as algorithms proposed in the recent 20�years and those proposed earlier. Then, some of the popular metaheuristic algorithms and their working principle are reviewed. This article further categorizes the latest metaheuristic search algorithm in the literature to indicate their efficiency in training ANN for various industry applications. More and more researchers tend to develop new hybrid optimization tools by combining two or more metaheuristic algorithms to optimize the training parameters of ANN. Generally, the algorithm�s optimal performance must be able to achieve a fine balance of their exploration and exploitation characteristics. Hence, this article tries to compare and summarize the properties of various metaheuristic algorithms in terms of their convergence rate and the ability to avoid the local minima. This information is useful for researchers working on algorithm hybridization by providing a good understanding of the convergence rate and the ability to find a global optimum. � 2021, The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature. Final 2023-05-29T09:06:33Z 2023-05-29T09:06:33Z 2021 Article 10.1007/s00500-021-05886-z 2-s2.0-85106739708 https://www.scopus.com/inward/record.uri?eid=2-s2.0-85106739708&doi=10.1007%2fs00500-021-05886-z&partnerID=40&md5=a2425a1c29c407743765bd946157b208 https://irepository.uniten.edu.my/handle/123456789/26073 25 16 11209 11233 Springer Science and Business Media Deutschland GmbH Scopus |
| institution |
Universiti Tenaga Nasional |
| building |
UNITEN Library |
| collection |
Institutional Repository |
| continent |
Asia |
| country |
Malaysia |
| content_provider |
Universiti Tenaga Nasional |
| content_source |
UNITEN Institutional Repository |
| url_provider |
http://dspace.uniten.edu.my/ |
| description |
Backpropagation; Gradient methods; Neural networks; Artificial neural network models; Complex applications; Exploration and exploitation; Gradient-based learning; Industry applications; Meta heuristic algorithm; Meta-heuristic search algorithms; Near-optimal solutions; Optimization |
| author2 |
55654589300 |
| author_facet |
55654589300 Chong H.Y. Yap H.J. Tan S.C. Yap K.S. Wong S.Y. |
| format |
Article |
| author |
Chong H.Y. Yap H.J. Tan S.C. Yap K.S. Wong S.Y. |
| spellingShingle |
Chong H.Y. Yap H.J. Tan S.C. Yap K.S. Wong S.Y. Advances of metaheuristic algorithms in training neural networks for industrial applications |
| author_sort |
Chong H.Y. |
| title |
Advances of metaheuristic algorithms in training neural networks for industrial applications |
| title_short |
Advances of metaheuristic algorithms in training neural networks for industrial applications |
| title_full |
Advances of metaheuristic algorithms in training neural networks for industrial applications |
| title_fullStr |
Advances of metaheuristic algorithms in training neural networks for industrial applications |
| title_full_unstemmed |
Advances of metaheuristic algorithms in training neural networks for industrial applications |
| title_sort |
advances of metaheuristic algorithms in training neural networks for industrial applications |
| publisher |
Springer Science and Business Media Deutschland GmbH |
| publishDate |
2023 |
| _version_ |
1806425914297286656 |
| score |
13.214268 |