Traffic control strategy for adaptive signal controller based on reinforcement learning and local communication channel
This research study is in the field of deep reinforcement learning (DRL) adaptive controllers. The developed DRL controller is an off-policy, model-free agent based on the Q-learning algorithm. The research aims to address several issues found in the existing DRL work direction. Issues related to th...
Saved in:
Main Author: | |
---|---|
Format: | Final Year Project / Dissertation / Thesis |
Published: |
2023
|
Subjects: | |
Online Access: | http://eprints.utar.edu.my/6239/1/MUAID_ABDULKAREEM_ALNAZIR_AHMED.pdf http://eprints.utar.edu.my/6239/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my-utar-eprints.6239 |
---|---|
record_format |
eprints |
spelling |
my-utar-eprints.62392024-03-11T14:48:02Z Traffic control strategy for adaptive signal controller based on reinforcement learning and local communication channel Muaid, Abdulkareem Alnazir Ahmed TJ Mechanical engineering and machinery TK Electrical engineering. Electronics Nuclear engineering This research study is in the field of deep reinforcement learning (DRL) adaptive controllers. The developed DRL controller is an off-policy, model-free agent based on the Q-learning algorithm. The research aims to address several issues found in the existing DRL work direction. Issues related to the ability of the DRL agent to mitigate signal operation under various traffic flow conditions, the extension of the model environment in the development process of the DRL agent, the under-representation and simplification of traffic dynamics, the utilisation of futuristic communication technology, and the ability of the DRL system to mitigate signalised junctions in an arterial network are pressing challenges for intelligent signal systems. An innovative control strategy is proposed to make the single system design efficient for global optimisation at network-level operation. The introduced downstream policy adapts the signal operation to the available capacity at discharge routes. An illustrative case study tests and evaluates the proposed control system. The micro-model simulated stochastic and dynamic traffic elements to represent the actual traffic. The rigorous tests showed that the proposed controller achieved the closest optimal flow condition at 0.80 for the network operation and outperformed other controllers in reducing waiting time costs (10%-36%), improving travel time experiences (5%−25%), and constituting the highest mean travel speed (3.4 m/s). 2023 Final Year Project / Dissertation / Thesis NonPeerReviewed application/pdf http://eprints.utar.edu.my/6239/1/MUAID_ABDULKAREEM_ALNAZIR_AHMED.pdf Muaid, Abdulkareem Alnazir Ahmed (2023) Traffic control strategy for adaptive signal controller based on reinforcement learning and local communication channel. PhD thesis, UTAR. http://eprints.utar.edu.my/6239/ |
institution |
Universiti Tunku Abdul Rahman |
building |
UTAR Library |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
Universiti Tunku Abdul Rahman |
content_source |
UTAR Institutional Repository |
url_provider |
http://eprints.utar.edu.my |
topic |
TJ Mechanical engineering and machinery TK Electrical engineering. Electronics Nuclear engineering |
spellingShingle |
TJ Mechanical engineering and machinery TK Electrical engineering. Electronics Nuclear engineering Muaid, Abdulkareem Alnazir Ahmed Traffic control strategy for adaptive signal controller based on reinforcement learning and local communication channel |
description |
This research study is in the field of deep reinforcement learning (DRL) adaptive controllers. The developed DRL controller is an off-policy, model-free agent based on the Q-learning algorithm. The research aims to address several issues found in the existing DRL work direction. Issues related to the ability of the DRL agent to mitigate signal operation under various traffic flow conditions, the extension of the model environment in the development process of the DRL agent, the under-representation and
simplification of traffic dynamics, the utilisation of futuristic communication technology, and the ability of the DRL system to mitigate signalised junctions in an arterial network are pressing challenges for intelligent signal systems. An innovative control strategy is proposed to make the single system design efficient for global optimisation at network-level operation. The introduced downstream policy adapts the signal operation to the available capacity at
discharge routes. An illustrative case study tests and evaluates the proposed control system. The micro-model simulated stochastic and dynamic traffic elements to represent the actual traffic. The rigorous tests showed that the proposed controller achieved the closest optimal flow condition at 0.80 for the network operation and outperformed other controllers in reducing waiting time costs (10%-36%), improving travel time experiences (5%−25%), and constituting the highest mean travel speed (3.4 m/s).
|
format |
Final Year Project / Dissertation / Thesis |
author |
Muaid, Abdulkareem Alnazir Ahmed |
author_facet |
Muaid, Abdulkareem Alnazir Ahmed |
author_sort |
Muaid, Abdulkareem Alnazir Ahmed |
title |
Traffic control strategy for adaptive signal controller based on reinforcement learning and local communication channel |
title_short |
Traffic control strategy for adaptive signal controller based on reinforcement learning and local communication channel |
title_full |
Traffic control strategy for adaptive signal controller based on reinforcement learning and local communication channel |
title_fullStr |
Traffic control strategy for adaptive signal controller based on reinforcement learning and local communication channel |
title_full_unstemmed |
Traffic control strategy for adaptive signal controller based on reinforcement learning and local communication channel |
title_sort |
traffic control strategy for adaptive signal controller based on reinforcement learning and local communication channel |
publishDate |
2023 |
url |
http://eprints.utar.edu.my/6239/1/MUAID_ABDULKAREEM_ALNAZIR_AHMED.pdf http://eprints.utar.edu.my/6239/ |
_version_ |
1794644944393076736 |
score |
13.18916 |