Real-time voice-controlled game interaction using convolutional neural networks

Speech recognition has gained growing popularity due to its wide applications in almost every field, ranging from wake-word recognition, emotion recognition, command recognition, and interactive game. Recently, there is a growing interest in using voice in the gaming industry. Voice-controlled inter...

Full description

Saved in:
Bibliographic Details
Main Authors: Waqar, Dania Maryam, Gunawan, Teddy Surya, Kartiwi, Mira, Ahmad, Robiah
Format: Conference or Workshop Item
Published: 2021
Subjects:
Online Access:http://eprints.utm.my/id/eprint/96665/
http://dx.doi.org/10.1109/ICSIMA50015.2021.9526318
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.utm.96665
record_format eprints
spelling my.utm.966652022-08-15T08:23:04Z http://eprints.utm.my/id/eprint/96665/ Real-time voice-controlled game interaction using convolutional neural networks Waqar, Dania Maryam Gunawan, Teddy Surya Kartiwi, Mira Ahmad, Robiah T Technology (General) Speech recognition has gained growing popularity due to its wide applications in almost every field, ranging from wake-word recognition, emotion recognition, command recognition, and interactive game. Recently, there is a growing interest in using voice in the gaming industry. Voice-controlled interaction made gaming much more accessible to a wider audience. However, the use of voice to control games requires real-time processing to avoid unwanted delay. This paper proposes speech command recognition using Convolutional Neural Networks (CNN) to control the popular snake game. First, the limited dataset for Up, Down, Left, Right speech commands was prepared for training, validation, and testing. Second, an optimum MFCC and CNN-based speech command recognition were proposed to recognize the four speech command. Results showed that our proposed algorithm could achieve high recognition accuracy of 96.5% and was able to detect all four commands. Finally, the proposed algorithm is integrated with a Python-based snake game. 2021 Conference or Workshop Item PeerReviewed Waqar, Dania Maryam and Gunawan, Teddy Surya and Kartiwi, Mira and Ahmad, Robiah (2021) Real-time voice-controlled game interaction using convolutional neural networks. In: 7th IEEE International Conference on Smart Instrumentation, Measurement and Applications, ICSIMA 2021, 23 - 25 August 2021, Virtual, Bandung. http://dx.doi.org/10.1109/ICSIMA50015.2021.9526318
institution Universiti Teknologi Malaysia
building UTM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Teknologi Malaysia
content_source UTM Institutional Repository
url_provider http://eprints.utm.my/
topic T Technology (General)
spellingShingle T Technology (General)
Waqar, Dania Maryam
Gunawan, Teddy Surya
Kartiwi, Mira
Ahmad, Robiah
Real-time voice-controlled game interaction using convolutional neural networks
description Speech recognition has gained growing popularity due to its wide applications in almost every field, ranging from wake-word recognition, emotion recognition, command recognition, and interactive game. Recently, there is a growing interest in using voice in the gaming industry. Voice-controlled interaction made gaming much more accessible to a wider audience. However, the use of voice to control games requires real-time processing to avoid unwanted delay. This paper proposes speech command recognition using Convolutional Neural Networks (CNN) to control the popular snake game. First, the limited dataset for Up, Down, Left, Right speech commands was prepared for training, validation, and testing. Second, an optimum MFCC and CNN-based speech command recognition were proposed to recognize the four speech command. Results showed that our proposed algorithm could achieve high recognition accuracy of 96.5% and was able to detect all four commands. Finally, the proposed algorithm is integrated with a Python-based snake game.
format Conference or Workshop Item
author Waqar, Dania Maryam
Gunawan, Teddy Surya
Kartiwi, Mira
Ahmad, Robiah
author_facet Waqar, Dania Maryam
Gunawan, Teddy Surya
Kartiwi, Mira
Ahmad, Robiah
author_sort Waqar, Dania Maryam
title Real-time voice-controlled game interaction using convolutional neural networks
title_short Real-time voice-controlled game interaction using convolutional neural networks
title_full Real-time voice-controlled game interaction using convolutional neural networks
title_fullStr Real-time voice-controlled game interaction using convolutional neural networks
title_full_unstemmed Real-time voice-controlled game interaction using convolutional neural networks
title_sort real-time voice-controlled game interaction using convolutional neural networks
publishDate 2021
url http://eprints.utm.my/id/eprint/96665/
http://dx.doi.org/10.1109/ICSIMA50015.2021.9526318
_version_ 1743107010950332416
score 13.222552