Multi-Modality and Feature Fusion-Based COVID-19 Detection Through Long Short-Term Memory

• Main Authors: Noureen Fatima, Rashid Jahangir, Ghulam Mujtaba, Adnan Akhunzada, Zahid Hussain Shaikh, Faiza Qureshi
• Format: Article
• Language: English; English
• Published: Tech Science Press 2022
• Subjects: QA75.5-76.95 Electronic computers. Computer science; RA648.5-767 Epidemics. Epidemiology. Quarantine. Disinfection
• Online Access: https://eprints.ums.edu.my/id/eprint/33313/1/Multi-Modality%20and%20Feature%20Fusion-Based%20COVID-19%20Detection%20Through%20Long%20Short-Term%20Memory.pdf; https://eprints.ums.edu.my/id/eprint/33313/2/Multi-Modality%20and%20Feature%20Fusion-Based%20COVID-19%20Detection%20Through%20Long%20Short-Term%20Memory1.pdf; https://eprints.ums.edu.my/id/eprint/33313/; https://www.techscience.com/cmc/v72n3/47453; https://www.techscience.com/cmc/v72n3/47453

The Coronavirus Disease 2019 (COVID-19) pandemic poses the worldwide challenges surpassing the boundaries of country, religion, race, and economy. The current benchmark method for the detection of COVID-19 is the reverse transcription polymerase chain reaction (RT-PCR) testing. Nevertheless, this testing method is accurate enough for the diagnosis of COVID19. However, it is time-consuming, expensive, expert-dependent, and violates social distancing. In this paper, this research proposed an effective multimodality-based and feature fusion-based (MMFF) COVID-19 detection technique through deep neural networks. In multi-modality, we have utilized the cough samples, breathe samples and sound samples of healthy as well as COVID-19 patients from publicly available COSWARA dataset. Extensive set of experimental analyses were performed to evaluate the performance of our proposed approach. Several useful features were extracted from the aforementioned modalities that were then fed as an input to long short-term memory recurrent neural network algorithms for the classification purpose. Extensive set of experimental analyses were performed to evaluate the performance of our proposed approach. The experimental results showed that our proposed approach outperformed compared to four baseline approaches published recently. We believe that our proposed technique will assists potential users to diagnose the COVID-19 without the intervention of any expert in minimum amount of time.