Real-Time Driver’s Monitoring Mobile Application through Head Pose, Drowsiness and Angry Detection
The current driver's monitoring system requires a set-up that includes the usage of a variety of camera equipment behind the steering wheel. It is highly impractical in a real-world environment as the set-up might cause annoyance or inconvenience to the driver. This project proposes a framework...
Saved in:
Main Authors: | , , , , |
---|---|
Format: | Proceeding |
Language: | English |
Published: |
IEEE
2021
|
Subjects: | |
Online Access: | http://ir.unimas.my/id/eprint/35580/1/mobile-1.pdf http://ir.unimas.my/id/eprint/35580/ https://ieeexplore.ieee.org/document/9467232 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my.unimas.ir.35580 |
---|---|
record_format |
eprints |
spelling |
my.unimas.ir.355802022-09-12T02:50:12Z http://ir.unimas.my/id/eprint/35580/ Real-Time Driver’s Monitoring Mobile Application through Head Pose, Drowsiness and Angry Detection Hamimah, Ujir Min Jie, Ee Mohammad Farhaan, Iqbal Khai Mun, Qan Irwandi Hipni, Mohamad Hipiny QA75 Electronic computers. Computer science The current driver's monitoring system requires a set-up that includes the usage of a variety of camera equipment behind the steering wheel. It is highly impractical in a real-world environment as the set-up might cause annoyance or inconvenience to the driver. This project proposes a framework of using mobile devices and cloud services to monitor the driver's head pose, detect angry expression and drowsiness, and alerting them with audio feedback. With the help of a phone camera functionality, the driver’s facial expression data can be collected then further analyzed via image processing under the Microsoft Azure platform. A working mobile app is developed, and it can detect the head pose, angry emotion, and drowsy drivers by monitoring their facial expressions. Whenever an angry or drowsy face is detected, pop-up alert messages and audio feedback will be given to the driver. The benefit of this mobile app is it can remind drivers to drive calmly and safely until drivers manage to handle their emotions where anger or drowsy is no longer detected. The performance of the mobile app in classifying anger emotion is achieved at 96.66% while the performance to detect driver’s drowsiness is 82.2%. On average, the head pose detection success rate across the six scenarios presented is 85.67%. IEEE 2021-07-01 Proceeding PeerReviewed text en http://ir.unimas.my/id/eprint/35580/1/mobile-1.pdf Hamimah, Ujir and Min Jie, Ee and Mohammad Farhaan, Iqbal and Khai Mun, Qan and Irwandi Hipni, Mohamad Hipiny (2021) Real-Time Driver’s Monitoring Mobile Application through Head Pose, Drowsiness and Angry Detection. In: 2021 8th International Conference on Computer and Communication Engineering (ICCCE), 22-23 June 2021, Kuala Lumpur, Malaysia. https://ieeexplore.ieee.org/document/9467232 10.1109/ICCCE50029.2021 |
institution |
Universiti Malaysia Sarawak |
building |
Centre for Academic Information Services (CAIS) |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
Universiti Malaysia Sarawak |
content_source |
UNIMAS Institutional Repository |
url_provider |
http://ir.unimas.my/ |
language |
English |
topic |
QA75 Electronic computers. Computer science |
spellingShingle |
QA75 Electronic computers. Computer science Hamimah, Ujir Min Jie, Ee Mohammad Farhaan, Iqbal Khai Mun, Qan Irwandi Hipni, Mohamad Hipiny Real-Time Driver’s Monitoring Mobile Application through Head Pose, Drowsiness and Angry Detection |
description |
The current driver's monitoring system requires a set-up that includes the usage of a variety of camera equipment behind the steering wheel. It is highly impractical in a real-world environment as the set-up might cause annoyance or inconvenience to the driver. This project proposes a framework of using mobile devices and cloud services to monitor the driver's head pose, detect angry expression and drowsiness, and alerting them with audio feedback. With the help of a phone camera functionality, the driver’s facial expression data can be collected
then further analyzed via image processing under the Microsoft Azure platform. A working mobile app is developed, and it can detect the head pose, angry emotion, and drowsy drivers by monitoring their facial expressions. Whenever an angry or drowsy face is detected, pop-up alert messages and audio feedback will be given to the driver. The benefit of this mobile
app is it can remind drivers to drive calmly and safely until drivers manage to handle their emotions where anger or drowsy is no longer detected. The performance of the mobile app in classifying anger emotion is achieved at 96.66% while the performance to detect driver’s drowsiness is 82.2%. On average, the head pose detection success rate across the six scenarios presented is 85.67%. |
format |
Proceeding |
author |
Hamimah, Ujir Min Jie, Ee Mohammad Farhaan, Iqbal Khai Mun, Qan Irwandi Hipni, Mohamad Hipiny |
author_facet |
Hamimah, Ujir Min Jie, Ee Mohammad Farhaan, Iqbal Khai Mun, Qan Irwandi Hipni, Mohamad Hipiny |
author_sort |
Hamimah, Ujir |
title |
Real-Time Driver’s Monitoring Mobile Application
through Head Pose, Drowsiness and Angry
Detection |
title_short |
Real-Time Driver’s Monitoring Mobile Application
through Head Pose, Drowsiness and Angry
Detection |
title_full |
Real-Time Driver’s Monitoring Mobile Application
through Head Pose, Drowsiness and Angry
Detection |
title_fullStr |
Real-Time Driver’s Monitoring Mobile Application
through Head Pose, Drowsiness and Angry
Detection |
title_full_unstemmed |
Real-Time Driver’s Monitoring Mobile Application
through Head Pose, Drowsiness and Angry
Detection |
title_sort |
real-time driver’s monitoring mobile application
through head pose, drowsiness and angry
detection |
publisher |
IEEE |
publishDate |
2021 |
url |
http://ir.unimas.my/id/eprint/35580/1/mobile-1.pdf http://ir.unimas.my/id/eprint/35580/ https://ieeexplore.ieee.org/document/9467232 |
_version_ |
1744357758806786048 |
score |
13.18916 |