Can evaluation patterns enable end users to evaluate the quality of an e-learning system? An exploratory study

This paper presents the results of an exploratory study whose main aim is to verify if the Pattern-Based (PB) inspection technique enables end users to perform reliable evaluation of e-learning systems in real work-related settings. The study involved 13 Polish and Italian participants, who did not have an HCI background, but used e-learning platforms for didactic and/or administrative purposes. Results of the study revealed that the participants were able to effectively and efficiently apply the PB inspection technique with minimum ef-fort. However, in some cases, participants complained that the technique has complicated the task of assessing the platform and made evaluator's work even more stressing. This study revealed some valuable suggestions to redesign the evaluation tools of the PB technique, in order to improve the focus on specific elements of the e-learning system and to streamline better the evaluation process.