Human emotion detection through speech and facial expressions
Estimation of human emotions using a computer has been difficult since when human engaged in a conversational secession. In this research work, a proposed hybrid system through facial expressions and speech is used to estimate basic emotions (angry, sad, happy, boredom, disgust and surprise) of a pe...
Saved in:
Main Authors: | , , |
---|---|
Format: | Conference or Workshop Item |
Published: |
Institute of Electrical and Electronics Engineers Inc.
2016
|
Online Access: | https://www.scopus.com/inward/record.uri?eid=2-s2.0-85010338177&doi=10.1109%2fICCOINS.2016.7783240&partnerID=40&md5=66b844ad0642d774d3e7656a78d0e28c http://eprints.utp.edu.my/30515/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my.utp.eprints.30515 |
---|---|
record_format |
eprints |
spelling |
my.utp.eprints.305152022-03-25T07:09:44Z Human emotion detection through speech and facial expressions Kudiri, K.M. Said, A.M. Nayan, M.Y. Estimation of human emotions using a computer has been difficult since when human engaged in a conversational secession. In this research work, a proposed hybrid system through facial expressions and speech is used to estimate basic emotions (angry, sad, happy, boredom, disgust and surprise) of a person when he is engaged in a conversational secession. Relative Bin Frequency Coefficients and Relative Sub-Image Based features are used for acoustic and visual data respectively. Support Vector Machine with radial basis kernel is used for classification. This research work revealed that the proposed feature extraction through speech and facial expression is the most prominent aspect affecting the emotion detection system accompanied by proposed fusion technique. Although, some aspects considered affecting the emotion detection system, this affect is relatively minor. It was observed that the performance of the bimodal emotion detection system is low than the unimodal emotion detection system through deliberate facial expressions. In order to deal with the issue, a suitable database is used. The results indicated that the proposed emotion detection system showed better performance with respect to basic emotional classes than the rest. © 2016 IEEE. Institute of Electrical and Electronics Engineers Inc. 2016 Conference or Workshop Item NonPeerReviewed https://www.scopus.com/inward/record.uri?eid=2-s2.0-85010338177&doi=10.1109%2fICCOINS.2016.7783240&partnerID=40&md5=66b844ad0642d774d3e7656a78d0e28c Kudiri, K.M. and Said, A.M. and Nayan, M.Y. (2016) Human emotion detection through speech and facial expressions. In: UNSPECIFIED. http://eprints.utp.edu.my/30515/ |
institution |
Universiti Teknologi Petronas |
building |
UTP Resource Centre |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
Universiti Teknologi Petronas |
content_source |
UTP Institutional Repository |
url_provider |
http://eprints.utp.edu.my/ |
description |
Estimation of human emotions using a computer has been difficult since when human engaged in a conversational secession. In this research work, a proposed hybrid system through facial expressions and speech is used to estimate basic emotions (angry, sad, happy, boredom, disgust and surprise) of a person when he is engaged in a conversational secession. Relative Bin Frequency Coefficients and Relative Sub-Image Based features are used for acoustic and visual data respectively. Support Vector Machine with radial basis kernel is used for classification. This research work revealed that the proposed feature extraction through speech and facial expression is the most prominent aspect affecting the emotion detection system accompanied by proposed fusion technique. Although, some aspects considered affecting the emotion detection system, this affect is relatively minor. It was observed that the performance of the bimodal emotion detection system is low than the unimodal emotion detection system through deliberate facial expressions. In order to deal with the issue, a suitable database is used. The results indicated that the proposed emotion detection system showed better performance with respect to basic emotional classes than the rest. © 2016 IEEE. |
format |
Conference or Workshop Item |
author |
Kudiri, K.M. Said, A.M. Nayan, M.Y. |
spellingShingle |
Kudiri, K.M. Said, A.M. Nayan, M.Y. Human emotion detection through speech and facial expressions |
author_facet |
Kudiri, K.M. Said, A.M. Nayan, M.Y. |
author_sort |
Kudiri, K.M. |
title |
Human emotion detection through speech and facial expressions |
title_short |
Human emotion detection through speech and facial expressions |
title_full |
Human emotion detection through speech and facial expressions |
title_fullStr |
Human emotion detection through speech and facial expressions |
title_full_unstemmed |
Human emotion detection through speech and facial expressions |
title_sort |
human emotion detection through speech and facial expressions |
publisher |
Institute of Electrical and Electronics Engineers Inc. |
publishDate |
2016 |
url |
https://www.scopus.com/inward/record.uri?eid=2-s2.0-85010338177&doi=10.1109%2fICCOINS.2016.7783240&partnerID=40&md5=66b844ad0642d774d3e7656a78d0e28c http://eprints.utp.edu.my/30515/ |
_version_ |
1738657118500683776 |
score |
13.209306 |