Development and Validation of Adaptable Rubrics for Programming Assessments: Measuring Computational Competencies

Abstract

Advanced technological innovations and problem-solving across various domains demand proficient programming skills. Thus, developing and measuring computational competencies are critical in this modern digital era. Despite their significance, assessing these competencies is challenging, especially when catering to personalized learning needs. Several assessment methods are available, yet there is a lack of fast, adaptable and validated evaluation tools. This study addresses this gap by developing and validating adaptable rubrics for assessing computational competencies and fostering improved learning outcomes in the computer programming domain. The preliminary rubric was developed per the JAVA programming curricula, educational frameworks, and experts' opinions. A sample of 300 students studying the JAVA programming language were assessed via a multiple-response objective assessment based on the initial rubric. The rubric-based evaluation results were subjected to rigorous statistical analyses, including exploratory and confirmatory factor analyses, correlation, and regression analyses. The findings yielded a four-factor validated adapted rubric structure emphasizing the required computational competencies in the programming domain. Further, moderate associations between rubric scores and Java academic evaluations were revealed, highlighting the predictive validity of rubric-based objective assessments. This research work contributes to the refinement of rubric and assessment practices in programming education, offering insights into the role of adaptable rubrics in promoting student learning and suggesting pedagogical approaches. The findings of this study hold practical implications for educators, curriculum designers, and policymakers. The targeted interventions, adapting rubric-based assessment criteria, improving pedagogical strategies, and enriching curriculum design ensure that the learning experiences of programming learners are tailored to their individual needs and aspirations.