A fine-grained assessment on novice programmers' gaze patterns on pseudocode problems

• Main Authors: Obaidellah, Unaizah Hanum, Blascheck, Tanja, Guarnera, Drew T., Maletic, Jonathan I.
• Format: Conference or Workshop Item
• Published: ASSOC COMPUTING MACHINERY 2020
• Subjects: QA75 Electronic computers. Computer science
• Online Access: http://eprints.um.edu.my/37134/; https://dl.acm.org/doi/10.1145/3379156.3391982

To better understand code comprehension and problem solving strategies, we conducted an eye tracking study that includes 51 undergraduate computer science students solving six pseudocode program comprehension tasks. Each task required students to order a sequence of pseudocode statements necessary to correctly solve a programming problem. We compare the viewing patterns of computer science students to evaluate changes in behavior while participants solve problems of varying difficulty. The intent is to find out if gaze patterns are similar prior to solving the task and if this pattern changes as the problems get more difficult. The findings show that as the difficulty increases regressions between areas of interest also tend to increase. Furthermore, an analysis of clusters of participants' common viewing patterns was performed to identify groups of participants' sharing similar gaze patterns prior to selecting their first choice of answer. Future work suggests an investigation on the relationship of these patterns with other background information (such as gender, age, English language proficiency, course completion) as well as performance (score, duration of task completion, competency level).