LONG SHORT-TERM MEMORY WITH GATED RECURRENT UNIT BASED ON HYPERPARAMETER SETTINGS AND HYBRIDIZATION FOR REFERENCE EVAPOTRANSPIRATION RATE PREDICTION

The evapotranspiration rate can be used to estimate water loss. However, there are 31 equations available to be chosen, and randomly choosing the equation might not project the actual results. This is very crucial because, without the equation, we cannot proceed with the parameter selection. These f...

Full description

Saved in:
Bibliographic Details
Main Authors: Hilmi, M.Z.B., Anwar, T., Rambli, D.R.B.A.
Format: Article
Published: Little Lion Scientific 2022
Online Access:http://scholars.utp.edu.my/id/eprint/33971/
https://www.scopus.com/inward/record.uri?eid=2-s2.0-85143440003&partnerID=40&md5=9dcf756ba40e51d832329eea1e0400eb
Tags: Add Tag
No Tags, Be the first to tag this record!
id oai:scholars.utp.edu.my:33971
record_format eprints
spelling oai:scholars.utp.edu.my:339712022-12-20T04:00:58Z http://scholars.utp.edu.my/id/eprint/33971/ LONG SHORT-TERM MEMORY WITH GATED RECURRENT UNIT BASED ON HYPERPARAMETER SETTINGS AND HYBRIDIZATION FOR REFERENCE EVAPOTRANSPIRATION RATE PREDICTION Hilmi, M.Z.B. Anwar, T. Rambli, D.R.B.A. The evapotranspiration rate can be used to estimate water loss. However, there are 31 equations available to be chosen, and randomly choosing the equation might not project the actual results. This is very crucial because, without the equation, we cannot proceed with the parameter selection. These findings can justify the parameter chosen for the prediction model development. Long Short-Term Memory (LSTM) is known for its ability to retain memory better than Recurrent Neural Network (RNN). This is due to LSTM architecture, where the memory cell is available to store memory for long-term dependency. RNN suffers from a vanishing gradient that can affect the prediction, whether in accuracy, precision, etc. LSTM was developed specifically to address the issue of RNN. Even though LSTM is better overall, it can be further enhanced. The proposed method is to adjust the Hyperparameter Settings and combine them with Hybridization. Our findings indicate that the prediction accuracy improved significantly. The hybrid model chosen was Gated Recurrent Unit (GRU), combined with LSTM and Hyperparameter Settings, resulting in the best and highest prediction accuracy compared to the LSTM Vanilla and LSTM with Hyperparameter Settings. LSTM Hyperparameter Settings and Hybridization dominate the top three scores. The scoring stretched until 11th place before the LSTM Hyperparameter Settings score came in. The top three scores were for Case 99, Case 36, and Case 90 with 0.0626, 0.06446, 0.06606 MAE, 0.00667, 0.00706, 0.00759 MSE, 0.0817, 0.084, 0.0871 RMSE and 0.99261, 0.99219, 0.9916 R , respectively. As for the LSTM Hyperparameter Settings score, 0.0712 MAE, 0.00861 MSE, 0.09278 RMSE, and 0.99047 R . © 2022 Little Lion Scientific. Little Lion Scientific 2022 Article NonPeerReviewed Hilmi, M.Z.B. and Anwar, T. and Rambli, D.R.B.A. (2022) LONG SHORT-TERM MEMORY WITH GATED RECURRENT UNIT BASED ON HYPERPARAMETER SETTINGS AND HYBRIDIZATION FOR REFERENCE EVAPOTRANSPIRATION RATE PREDICTION. Journal of Theoretical and Applied Information Technology, 100 (22). pp. 6702-6714. ISSN 19928645 https://www.scopus.com/inward/record.uri?eid=2-s2.0-85143440003&partnerID=40&md5=9dcf756ba40e51d832329eea1e0400eb
institution Universiti Teknologi Petronas
building UTP Resource Centre
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Teknologi Petronas
content_source UTP Institutional Repository
url_provider http://eprints.utp.edu.my/
description The evapotranspiration rate can be used to estimate water loss. However, there are 31 equations available to be chosen, and randomly choosing the equation might not project the actual results. This is very crucial because, without the equation, we cannot proceed with the parameter selection. These findings can justify the parameter chosen for the prediction model development. Long Short-Term Memory (LSTM) is known for its ability to retain memory better than Recurrent Neural Network (RNN). This is due to LSTM architecture, where the memory cell is available to store memory for long-term dependency. RNN suffers from a vanishing gradient that can affect the prediction, whether in accuracy, precision, etc. LSTM was developed specifically to address the issue of RNN. Even though LSTM is better overall, it can be further enhanced. The proposed method is to adjust the Hyperparameter Settings and combine them with Hybridization. Our findings indicate that the prediction accuracy improved significantly. The hybrid model chosen was Gated Recurrent Unit (GRU), combined with LSTM and Hyperparameter Settings, resulting in the best and highest prediction accuracy compared to the LSTM Vanilla and LSTM with Hyperparameter Settings. LSTM Hyperparameter Settings and Hybridization dominate the top three scores. The scoring stretched until 11th place before the LSTM Hyperparameter Settings score came in. The top three scores were for Case 99, Case 36, and Case 90 with 0.0626, 0.06446, 0.06606 MAE, 0.00667, 0.00706, 0.00759 MSE, 0.0817, 0.084, 0.0871 RMSE and 0.99261, 0.99219, 0.9916 R , respectively. As for the LSTM Hyperparameter Settings score, 0.0712 MAE, 0.00861 MSE, 0.09278 RMSE, and 0.99047 R . © 2022 Little Lion Scientific.
format Article
author Hilmi, M.Z.B.
Anwar, T.
Rambli, D.R.B.A.
spellingShingle Hilmi, M.Z.B.
Anwar, T.
Rambli, D.R.B.A.
LONG SHORT-TERM MEMORY WITH GATED RECURRENT UNIT BASED ON HYPERPARAMETER SETTINGS AND HYBRIDIZATION FOR REFERENCE EVAPOTRANSPIRATION RATE PREDICTION
author_facet Hilmi, M.Z.B.
Anwar, T.
Rambli, D.R.B.A.
author_sort Hilmi, M.Z.B.
title LONG SHORT-TERM MEMORY WITH GATED RECURRENT UNIT BASED ON HYPERPARAMETER SETTINGS AND HYBRIDIZATION FOR REFERENCE EVAPOTRANSPIRATION RATE PREDICTION
title_short LONG SHORT-TERM MEMORY WITH GATED RECURRENT UNIT BASED ON HYPERPARAMETER SETTINGS AND HYBRIDIZATION FOR REFERENCE EVAPOTRANSPIRATION RATE PREDICTION
title_full LONG SHORT-TERM MEMORY WITH GATED RECURRENT UNIT BASED ON HYPERPARAMETER SETTINGS AND HYBRIDIZATION FOR REFERENCE EVAPOTRANSPIRATION RATE PREDICTION
title_fullStr LONG SHORT-TERM MEMORY WITH GATED RECURRENT UNIT BASED ON HYPERPARAMETER SETTINGS AND HYBRIDIZATION FOR REFERENCE EVAPOTRANSPIRATION RATE PREDICTION
title_full_unstemmed LONG SHORT-TERM MEMORY WITH GATED RECURRENT UNIT BASED ON HYPERPARAMETER SETTINGS AND HYBRIDIZATION FOR REFERENCE EVAPOTRANSPIRATION RATE PREDICTION
title_sort long short-term memory with gated recurrent unit based on hyperparameter settings and hybridization for reference evapotranspiration rate prediction
publisher Little Lion Scientific
publishDate 2022
url http://scholars.utp.edu.my/id/eprint/33971/
https://www.scopus.com/inward/record.uri?eid=2-s2.0-85143440003&partnerID=40&md5=9dcf756ba40e51d832329eea1e0400eb
_version_ 1753790761803972608
score 13.211869