A hybrid vegetation detection framework: Integrating vegetation indices and convolutional neural network
Vegetation inspection and monitoring is a time-consuming task. In the era of industrial revolution 4.0 (IR 4.0), unmanned aerial vehicles (UAV), commercially known as drones, are in demand, being adopted for vegetation inspection and monitoring activities. However, most off-the-shelf drones are leas...
Saved in:
Main Authors: | , , , , , , , |
---|---|
Other Authors: | |
Format: | Article |
Published: |
MDPI
2023
|
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my.uniten.dspace-25917 |
---|---|
record_format |
dspace |
spelling |
my.uniten.dspace-259172023-05-29T17:05:32Z A hybrid vegetation detection framework: Integrating vegetation indices and convolutional neural network Hashim W. Eng L.S. Alkawsi G. Ismail R. Alkahtani A.A. Dzulkifly S. Baashar Y. Hussain A. 11440260100 57205240446 57191982354 36080877900 55646765500 55569716800 56768090200 56212649500 Vegetation inspection and monitoring is a time-consuming task. In the era of industrial revolution 4.0 (IR 4.0), unmanned aerial vehicles (UAV), commercially known as drones, are in demand, being adopted for vegetation inspection and monitoring activities. However, most off-the-shelf drones are least favoured by vegetation maintenance departments for on-site inspection due to limited spectral bands camera restricting advanced vegetation analysis. Most of these drones are normally equipped with a normal red, green, and blue (RGB) camera. Additional spectral bands are found to produce more accurate analysis during vegetation inspection, but at the cost of advanced camera functionalities, such as multispectral camera. Vegetation indices (VI) is a technique to maximize detection sensitivity related to vegetation characteristics while minimizing other factors which are not categorised otherwise. The emergence of machine learning has slowly influenced the existing vegetation analysis technique in order to improve detection accuracy. This study focuses on exploring VI techniques in identifying vegetation objects. The selected VIs investigated are Visible Atmospheric Resistant Index (VARI), Green Leaf Index (GLI), and Vegetation Index Green (VIgreen). The chosen machine learning technique is You Only Look Once (YOLO), which is a clever convolutional neural network (CNN) offering object detection in real time. The CNN model has a symmetrical structure along the direction of the tensor flow. Several series of data collection have been conducted at identified locations to obtain aerial images. The proposed hybrid methods were tested on captured aerial images to observe vegetation detection performance. Segmentation in image analysis is a process to divide the targeted pixels for further detection testing. Based on our findings, more than 70% of the vegetation objects in the images were accurately detected, which reduces the misdetection issue faced by previous VI techniques. On the other hand, hybrid segmentation methods perform best with the combination of VARI and YOLO at 84% detection accuracy. � 2021 by the authors. Licensee MDPI, Basel, Switzerland. Final 2023-05-29T09:05:32Z 2023-05-29T09:05:32Z 2021 Article 10.3390/sym13112190 2-s2.0-85119601980 https://www.scopus.com/inward/record.uri?eid=2-s2.0-85119601980&doi=10.3390%2fsym13112190&partnerID=40&md5=b79b6d9db832874ace524bf4c3083494 https://irepository.uniten.edu.my/handle/123456789/25917 13 11 2190 All Open Access, Gold MDPI Scopus |
institution |
Universiti Tenaga Nasional |
building |
UNITEN Library |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
Universiti Tenaga Nasional |
content_source |
UNITEN Institutional Repository |
url_provider |
http://dspace.uniten.edu.my/ |
description |
Vegetation inspection and monitoring is a time-consuming task. In the era of industrial revolution 4.0 (IR 4.0), unmanned aerial vehicles (UAV), commercially known as drones, are in demand, being adopted for vegetation inspection and monitoring activities. However, most off-the-shelf drones are least favoured by vegetation maintenance departments for on-site inspection due to limited spectral bands camera restricting advanced vegetation analysis. Most of these drones are normally equipped with a normal red, green, and blue (RGB) camera. Additional spectral bands are found to produce more accurate analysis during vegetation inspection, but at the cost of advanced camera functionalities, such as multispectral camera. Vegetation indices (VI) is a technique to maximize detection sensitivity related to vegetation characteristics while minimizing other factors which are not categorised otherwise. The emergence of machine learning has slowly influenced the existing vegetation analysis technique in order to improve detection accuracy. This study focuses on exploring VI techniques in identifying vegetation objects. The selected VIs investigated are Visible Atmospheric Resistant Index (VARI), Green Leaf Index (GLI), and Vegetation Index Green (VIgreen). The chosen machine learning technique is You Only Look Once (YOLO), which is a clever convolutional neural network (CNN) offering object detection in real time. The CNN model has a symmetrical structure along the direction of the tensor flow. Several series of data collection have been conducted at identified locations to obtain aerial images. The proposed hybrid methods were tested on captured aerial images to observe vegetation detection performance. Segmentation in image analysis is a process to divide the targeted pixels for further detection testing. Based on our findings, more than 70% of the vegetation objects in the images were accurately detected, which reduces the misdetection issue faced by previous VI techniques. On the other hand, hybrid segmentation methods perform best with the combination of VARI and YOLO at 84% detection accuracy. � 2021 by the authors. Licensee MDPI, Basel, Switzerland. |
author2 |
11440260100 |
author_facet |
11440260100 Hashim W. Eng L.S. Alkawsi G. Ismail R. Alkahtani A.A. Dzulkifly S. Baashar Y. Hussain A. |
format |
Article |
author |
Hashim W. Eng L.S. Alkawsi G. Ismail R. Alkahtani A.A. Dzulkifly S. Baashar Y. Hussain A. |
spellingShingle |
Hashim W. Eng L.S. Alkawsi G. Ismail R. Alkahtani A.A. Dzulkifly S. Baashar Y. Hussain A. A hybrid vegetation detection framework: Integrating vegetation indices and convolutional neural network |
author_sort |
Hashim W. |
title |
A hybrid vegetation detection framework: Integrating vegetation indices and convolutional neural network |
title_short |
A hybrid vegetation detection framework: Integrating vegetation indices and convolutional neural network |
title_full |
A hybrid vegetation detection framework: Integrating vegetation indices and convolutional neural network |
title_fullStr |
A hybrid vegetation detection framework: Integrating vegetation indices and convolutional neural network |
title_full_unstemmed |
A hybrid vegetation detection framework: Integrating vegetation indices and convolutional neural network |
title_sort |
hybrid vegetation detection framework: integrating vegetation indices and convolutional neural network |
publisher |
MDPI |
publishDate |
2023 |
_version_ |
1806426568511193088 |
score |
13.222552 |