Automated detection and classification of oral lesions using deep learning for early detection of oral cancer
Oral cancer is a major global health issue accounting for 177,384 deaths in 2018 and it is most prevalent in low- and middle-income countries. Enabling automation in the identification of potentially malignant and malignant lesions in the oral cavity would potentially lead to low-cost and early diag...
Saved in:
Main Authors: | , , , , , , , , , , , , , , , |
---|---|
Format: | Article |
Published: |
Institute of Electrical and Electronics Engineers
2020
|
Subjects: | |
Online Access: | http://eprints.um.edu.my/37201/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my.um.eprints.37201 |
---|---|
record_format |
eprints |
spelling |
my.um.eprints.372012023-03-15T04:07:11Z http://eprints.um.edu.my/37201/ Automated detection and classification of oral lesions using deep learning for early detection of oral cancer Welikala, Roshan Alex Remagnino, Paolo Lim, Jian Han Chan, Chee Seng Rajendran, Senthilmani Kallarakkal, Thomas George Zain, Rosnah Binti Jayasinghe, Ruwan Duminda Rimal, Jyotsna Kerr, Alexander Ross Amtha, Rahmi Patil, Karthikeya Tilakaratne, Wanninayake Mudiyanselage Gibson, John Cheong, Sok Ching Barman, Sarah Ann QA75 Electronic computers. Computer science RK Dentistry Oral cancer is a major global health issue accounting for 177,384 deaths in 2018 and it is most prevalent in low- and middle-income countries. Enabling automation in the identification of potentially malignant and malignant lesions in the oral cavity would potentially lead to low-cost and early diagnosis of the disease. Building a large library of well-annotated oral lesions is key. As part of the MeMoSA(R)(Mobile Mouth Screening Anywhere) project, images are currently in the process of being gathered from clinical experts from across the world, who have been provided with an annotation tool to produce rich labels. A novel strategy to combine bounding box annotations from multiple clinicians is provided in this paper. Further to this, deep neural networks were used to build automated systems, in which complex patterns were derived for tackling this difficult task. Using the initial data gathered in this study, two deep learning based computer vision approaches were assessed for the automated detection and classification of oral lesions for the early detection of oral cancer, these were image classification with ResNet-101 and object detection with the Faster R-CNN. Image classification achieved an F-1 score of 87.07% for identification of images that contained lesions and 78.30% for the identification of images that required referral. Object detection achieved an F-1 score of 41.18% for the detection of lesions that required referral. Further performances are reported with respect to classifying according to the type of referral decision. Our initial results demonstrate deep learning has the potential to tackle this challenging task. Institute of Electrical and Electronics Engineers 2020 Article PeerReviewed Welikala, Roshan Alex and Remagnino, Paolo and Lim, Jian Han and Chan, Chee Seng and Rajendran, Senthilmani and Kallarakkal, Thomas George and Zain, Rosnah Binti and Jayasinghe, Ruwan Duminda and Rimal, Jyotsna and Kerr, Alexander Ross and Amtha, Rahmi and Patil, Karthikeya and Tilakaratne, Wanninayake Mudiyanselage and Gibson, John and Cheong, Sok Ching and Barman, Sarah Ann (2020) Automated detection and classification of oral lesions using deep learning for early detection of oral cancer. IEEE Access, 8. pp. 132677-132693. ISSN 2169-3536, DOI https://doi.org/10.1109/ACCESS.2020.3010180 <https://doi.org/10.1109/ACCESS.2020.3010180>. 10.1109/ACCESS.2020.3010180 |
institution |
Universiti Malaya |
building |
UM Library |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
Universiti Malaya |
content_source |
UM Research Repository |
url_provider |
http://eprints.um.edu.my/ |
topic |
QA75 Electronic computers. Computer science RK Dentistry |
spellingShingle |
QA75 Electronic computers. Computer science RK Dentistry Welikala, Roshan Alex Remagnino, Paolo Lim, Jian Han Chan, Chee Seng Rajendran, Senthilmani Kallarakkal, Thomas George Zain, Rosnah Binti Jayasinghe, Ruwan Duminda Rimal, Jyotsna Kerr, Alexander Ross Amtha, Rahmi Patil, Karthikeya Tilakaratne, Wanninayake Mudiyanselage Gibson, John Cheong, Sok Ching Barman, Sarah Ann Automated detection and classification of oral lesions using deep learning for early detection of oral cancer |
description |
Oral cancer is a major global health issue accounting for 177,384 deaths in 2018 and it is most prevalent in low- and middle-income countries. Enabling automation in the identification of potentially malignant and malignant lesions in the oral cavity would potentially lead to low-cost and early diagnosis of the disease. Building a large library of well-annotated oral lesions is key. As part of the MeMoSA(R)(Mobile Mouth Screening Anywhere) project, images are currently in the process of being gathered from clinical experts from across the world, who have been provided with an annotation tool to produce rich labels. A novel strategy to combine bounding box annotations from multiple clinicians is provided in this paper. Further to this, deep neural networks were used to build automated systems, in which complex patterns were derived for tackling this difficult task. Using the initial data gathered in this study, two deep learning based computer vision approaches were assessed for the automated detection and classification of oral lesions for the early detection of oral cancer, these were image classification with ResNet-101 and object detection with the Faster R-CNN. Image classification achieved an F-1 score of 87.07% for identification of images that contained lesions and 78.30% for the identification of images that required referral. Object detection achieved an F-1 score of 41.18% for the detection of lesions that required referral. Further performances are reported with respect to classifying according to the type of referral decision. Our initial results demonstrate deep learning has the potential to tackle this challenging task. |
format |
Article |
author |
Welikala, Roshan Alex Remagnino, Paolo Lim, Jian Han Chan, Chee Seng Rajendran, Senthilmani Kallarakkal, Thomas George Zain, Rosnah Binti Jayasinghe, Ruwan Duminda Rimal, Jyotsna Kerr, Alexander Ross Amtha, Rahmi Patil, Karthikeya Tilakaratne, Wanninayake Mudiyanselage Gibson, John Cheong, Sok Ching Barman, Sarah Ann |
author_facet |
Welikala, Roshan Alex Remagnino, Paolo Lim, Jian Han Chan, Chee Seng Rajendran, Senthilmani Kallarakkal, Thomas George Zain, Rosnah Binti Jayasinghe, Ruwan Duminda Rimal, Jyotsna Kerr, Alexander Ross Amtha, Rahmi Patil, Karthikeya Tilakaratne, Wanninayake Mudiyanselage Gibson, John Cheong, Sok Ching Barman, Sarah Ann |
author_sort |
Welikala, Roshan Alex |
title |
Automated detection and classification of oral lesions using deep learning for early detection of oral cancer |
title_short |
Automated detection and classification of oral lesions using deep learning for early detection of oral cancer |
title_full |
Automated detection and classification of oral lesions using deep learning for early detection of oral cancer |
title_fullStr |
Automated detection and classification of oral lesions using deep learning for early detection of oral cancer |
title_full_unstemmed |
Automated detection and classification of oral lesions using deep learning for early detection of oral cancer |
title_sort |
automated detection and classification of oral lesions using deep learning for early detection of oral cancer |
publisher |
Institute of Electrical and Electronics Engineers |
publishDate |
2020 |
url |
http://eprints.um.edu.my/37201/ |
_version_ |
1761616810886561792 |
score |
13.2014675 |