Reliability of online simulation-based assessment to measure cognitive performance and its acceptance among pharmacy students
The majority of conventional evaluations of cognitive skills (CSs) utilise paper-based or online multiple-choice questions or single best-answer questions. However, examination that uses online simulation of real scenarios has the potential to complement medium-to-high level CSs that make use of the...
Saved in:
Main Authors: | , , , , , , , |
---|---|
Format: | Article |
Published: |
Penerbit Universiti Sains Malaysia
2022
|
Subjects: | |
Online Access: | http://eprints.um.edu.my/43957/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my.um.eprints.43957 |
---|---|
record_format |
eprints |
spelling |
my.um.eprints.439572024-01-26T03:35:30Z http://eprints.um.edu.my/43957/ Reliability of online simulation-based assessment to measure cognitive performance and its acceptance among pharmacy students A. Wahab, Izyan Shamsuddin, Noorasyikin Alwi, Syireen Abd Wahab, Mohd Shahezwan Ali, Majid Ming, Long Chiau Hisham, Shairyzah Ahmad Jamil, Nurdiana RS Pharmacy and materia medica The majority of conventional evaluations of cognitive skills (CSs) utilise paper-based or online multiple-choice questions or single best-answer questions. However, examination that uses online simulation of real scenarios has the potential to complement medium-to-high level CSs that make use of the intellectual capabilities of applying, analysing and evaluating complex information. Nevertheless, the reliability of online simulation as an alternative learning and assessment tool for Malaysian pharmacy courses has never been investigated. This paper illustrates online remote simulation-based assessment, its psychometric properties and students’ feedback towards this new learning and assessment tool opportunity. A virtual web-based simulation examination consisting of three infectious disease scenarios was administered in an undergraduate pharmacy course to assess physically distanced students for medium-level clinical pharmacy CSs. Students responded through written typed communication to online enquiries from health professionals, patients or caretakers’ avatars. Rasch analysis and a feedback survey were employed to measure the reliability of online simulation and to understand students’ experiences with the new web-based tool. This study found that the remote simulation examination had good reliability (ir = 0.95, pr = 0.73) for measuring medium-level clinical pharmacy CSs. The students’ survey indicates that the web-based simulation activities improved knowledge, engagement and cognitive reasoning. This article contributes to the pharmacy education literature by illustrating how a different type of assessment is feasible and reliable for evaluating students’ CSs for final examinations and potentially has equitable opportunities for distance-learning students to enhance their learning capabilities and show their performances. Future research to investigate the potential of remote online simulation examinations for inter-professional learning and assessment is highly recommended. © Malaysian Association of Education in Medicine and Health Sciences and Penerbit Universiti Sains Malaysia. 2022. Penerbit Universiti Sains Malaysia 2022 Article PeerReviewed A. Wahab, Izyan and Shamsuddin, Noorasyikin and Alwi, Syireen and Abd Wahab, Mohd Shahezwan and Ali, Majid and Ming, Long Chiau and Hisham, Shairyzah Ahmad and Jamil, Nurdiana (2022) Reliability of online simulation-based assessment to measure cognitive performance and its acceptance among pharmacy students. Education in Medicine Journal, 14 (4). 45 – 53. ISSN 2180-1932, DOI https://doi.org/10.21315/eimj2022.14.4.4 <https://doi.org/10.21315/eimj2022.14.4.4>. 10.21315/eimj2022.14.4.4 |
institution |
Universiti Malaya |
building |
UM Library |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
Universiti Malaya |
content_source |
UM Research Repository |
url_provider |
http://eprints.um.edu.my/ |
topic |
RS Pharmacy and materia medica |
spellingShingle |
RS Pharmacy and materia medica A. Wahab, Izyan Shamsuddin, Noorasyikin Alwi, Syireen Abd Wahab, Mohd Shahezwan Ali, Majid Ming, Long Chiau Hisham, Shairyzah Ahmad Jamil, Nurdiana Reliability of online simulation-based assessment to measure cognitive performance and its acceptance among pharmacy students |
description |
The majority of conventional evaluations of cognitive skills (CSs) utilise paper-based or online multiple-choice questions or single best-answer questions. However, examination that uses online simulation of real scenarios has the potential to complement medium-to-high level CSs that make use of the intellectual capabilities of applying, analysing and evaluating complex information. Nevertheless, the reliability of online simulation as an alternative learning and assessment tool for Malaysian pharmacy courses has never been investigated. This paper illustrates online remote simulation-based assessment, its psychometric properties and students’ feedback towards this new learning and assessment tool opportunity. A virtual web-based simulation examination consisting of three infectious disease scenarios was administered in an undergraduate pharmacy course to assess physically distanced students for medium-level clinical pharmacy CSs. Students responded through written typed communication to online enquiries from health professionals, patients or caretakers’ avatars. Rasch analysis and a feedback survey were employed to measure the reliability of online simulation and to understand students’ experiences with the new web-based tool. This study found that the remote simulation examination had good reliability (ir = 0.95, pr = 0.73) for measuring medium-level clinical pharmacy CSs. The students’ survey indicates that the web-based simulation activities improved knowledge, engagement and cognitive reasoning. This article contributes to the pharmacy education literature by illustrating how a different type of assessment is feasible and reliable for evaluating students’ CSs for final examinations and potentially has equitable opportunities for distance-learning students to enhance their learning capabilities and show their performances. Future research to investigate the potential of remote online simulation examinations for inter-professional learning and assessment is highly recommended. © Malaysian Association of Education in Medicine and Health Sciences and Penerbit Universiti Sains Malaysia. 2022. |
format |
Article |
author |
A. Wahab, Izyan Shamsuddin, Noorasyikin Alwi, Syireen Abd Wahab, Mohd Shahezwan Ali, Majid Ming, Long Chiau Hisham, Shairyzah Ahmad Jamil, Nurdiana |
author_facet |
A. Wahab, Izyan Shamsuddin, Noorasyikin Alwi, Syireen Abd Wahab, Mohd Shahezwan Ali, Majid Ming, Long Chiau Hisham, Shairyzah Ahmad Jamil, Nurdiana |
author_sort |
A. Wahab, Izyan |
title |
Reliability of online simulation-based assessment to measure cognitive performance and its acceptance among pharmacy students |
title_short |
Reliability of online simulation-based assessment to measure cognitive performance and its acceptance among pharmacy students |
title_full |
Reliability of online simulation-based assessment to measure cognitive performance and its acceptance among pharmacy students |
title_fullStr |
Reliability of online simulation-based assessment to measure cognitive performance and its acceptance among pharmacy students |
title_full_unstemmed |
Reliability of online simulation-based assessment to measure cognitive performance and its acceptance among pharmacy students |
title_sort |
reliability of online simulation-based assessment to measure cognitive performance and its acceptance among pharmacy students |
publisher |
Penerbit Universiti Sains Malaysia |
publishDate |
2022 |
url |
http://eprints.um.edu.my/43957/ |
_version_ |
1789424633114525696 |
score |
13.18916 |