The Student Expectations of Learning Analytics Questionnaire (SELAQ)

TitleThe Student Expectations of Learning Analytics Questionnaire (SELAQ)
Publication TypeJournal Article
Year of Publication2019
AuthorsWhitelock-Wainwright A, Gašević D, Tejeiro R, Tsai Y-S, Bennett K
JournalJournal of Computer Assisted Learning
Date Published2019/6/18
Type of ArticleArticle
ISBN Number0266-4909
Keywordshigher education, ideal expectations, Learning analytics, predicted expectations, student expectations
Abstract

Student engagement within the development of learning analytics services in Higher Education is an important challenge for the researchers and practitioners to address. Despite calls for greater inclusion of stakeholders, there still remains only a small number of investigations into students’ beliefs and expectations towards learning analytics services. To meet the challenge of greater participation from the student population in the implementation of learning analytics services, this paper presents a descriptive instrument to measure student expectations (ideal and predicted) of learning analytics services. The scales used in the instrument have been grounded in theoretical framework of expectations, with a specific focus on ideal (hopes) and predicted (realistic beliefs) expectations. Items were then generated on the basis of four identified themes (Ethical and Privacy Expectations, Agency Expectations, Intervention Expectations, and Meaningfulness Expectations), which emerged through the undertaking of a review of the learning analytics literature. The developed instrument was then subject to peer review, pilot testing, and a full roll-out across students at two universities. The results of an exploratory factor analysis and the results from both an exploratory structural equation model and confirmatory factor analysis supported a two-factor structure best accounted for the data pertaining to ideal and predicted expectations. Factor one refers to Ethical and Privacy Expectations, whilst factor two covers Service Feature Expectations. In addition, both scales (ideal and predicted) were found to have good internal reliability. The 12-item Student Expectations of Learning Analytics Questionnaire (SELAQ) provides researchers and practitioners with a reliable and valid instrument to collect quantitative measures of students’ expectations of learning analytics services.

DOI10.1111/jcal.12366
Short TitleJournal of Computer Assisted Learning
Abstract

Student engagement within the development of learning analytics services in Higher Education is an important challenge for the researchers and practitioners to address. Despite calls for greater inclusion of stakeholders, there still remains only a small number of investigations into students’ beliefs and expectations towards learning analytics services. To meet the challenge of greater participation from the student population in the implementation of learning analytics services, this paper presents a descriptive instrument to measure student expectations (ideal and predicted) of learning analytics services. The scales used in the instrument have been grounded in theoretical framework of expectations, with a specific focus on ideal (hopes) and predicted (realistic beliefs) expectations. Items were then generated on the basis of four identified themes (Ethical and Privacy Expectations, Agency Expectations, Intervention Expectations, and Meaningfulness Expectations), which emerged through the undertaking of a review of the learning analytics literature. The developed instrument was then subject to peer review, pilot testing, and a full roll-out across students at two universities. The results of an exploratory factor analysis and the results from both an exploratory structural equation model and confirmatory factor analysis supported a two-factor structure best accounted for the data pertaining to ideal and predicted expectations. Factor one refers to Ethical and Privacy Expectations, whilst factor two covers Service Feature Expectations. In addition, both scales (ideal and predicted) were found to have good internal reliability. The 12-item Student Expectations of Learning Analytics Questionnaire (SELAQ) provides researchers and practitioners with a reliable and valid instrument to collect quantitative measures of students’ expectations of learning analytics services.