Comparison Method Q-Learning and SARSA for Simulation of Drone Controller using Reinforcement Learning

• Main Authors: Mohamad Hafiz Abu Bakar, Mohamad Hafiz Abu Bakar, Abu Ubaidah Shamsudin, Abu Ubaidah Shamsudin, Ruzairi Abdul Rahim, Ruzairi Abdul Rahim, Zubair Adil Soomro, Zubair Adil Soomro, Andi Adrianshah, Andi Adrianshah
• Format: Article
• Language: English
• Published: semarak ilmu 2023
• Subjects: T Technology (General)
• Online Access: http://eprints.uthm.edu.my/10521/1/J16168_3519c3c49183a6f808613789cd52277b.pdf; http://eprints.uthm.edu.my/10521/; https://doi.org/10.37934/araset.30.3.6978

Nowadays, the advancement of drones is also factored in the development of a world surrounded by technologies. One of the aspects emphasized here is the difficulty of controlling the drone, and the system developed is still under full control by the users as well. Reinforcement Learning is used to enable the system to operate automatically, thus drone will learn the next movement based on the interaction between the agent and the environment. Through this study, Q-Learning and State-Action-Reward-StateAction (SARSA) are used in this study and the comparison of results involving both the performance and effectiveness of the system based on the simulation of both methods can be seen through the analysis. A comparison of both Q-learning and State-ActionReward-State-Action (SARSA) based systems in autonomous drone application was performed for evaluation in this study. According to this simulation process is shows that Q-Learning is a better performance and effective to train the system to achieve desire compared with SARSA algorithm for drone controller.