Abstract:
Computational Thinking (CT) Skills are growing in importance as generative AI influences the skills required for a modern workforce. A review of the literature shows a concentration of CT research at the primary and secondary education levels, with a clear research gap and limited availability of practical, validated CT assessment tools for use in Higher Education. The Algorithmic Thinking Test for Adults is a 20-item validated scale targeting several CT components with an execution time of approximately 70 minutes. A pre-pilot study using the ATTA highlighted challenges related to timing and execution time when zero responses were collected. A revised pilot study with 125 invited participants achieved a 44% response rate. Participant feedback coupled with completion rates and item non-response rates supported a need for a reduction of the 20-item scale to improve feasibility in this context. This research aims to evaluate the suitability, reliability, and relevance of the Algorithmic Thinking Test for Adults for use with undergraduate computing students and explores adaptations to improve its feasibility in time-constrained classroom settings. Iterative item removal and exploratory factor analysis produced a shortened 9-item scale with acceptable reliability indicated by Cronbach’s α of .764. Findings provide preliminary evidence that a shortened ATTA with reduced execution time may improve feasibility while retaining acceptable internal consistency.
PPIG 2026 - 37th Annual Workshop
Evaluating and Adapting the ATTA for Computational Thinking Skills Assessment in Higher Education: A Pilot Study