A school district in Texas wanted to investigate the effectiveness of Imagine Learning’s Blueprint product for the 2017–2018 academic year. For the study, the district chose three schools to pilot Blueprint (Pre-K grade-level) before an assessment was administered (the treatment schools) and three other schools of similar demographics to serve as control schools. Baseline equivalence of the treatment and control groups of students is assumed to exist via the selection process of schools.
The study compared the overall accuracy of treatment students and control students on the Blueprint assessment. In this comparison, only the students that submitted answers for all thirty-five questions were included—925 students in total. Comparisons were made based on post-test performance on the Blueprint assessment.
The boxplots for the assessment scores (percentage correct) of the control and treatment students are shown in Figure 1. The horizontal lines indicate the median scores of each group. On average, treatment students scored higher (40.01) on the posttest than control students (28.12) meaning students who used Blueprint scored 42% higher on program assessments than non-users.
The study also analyzed student performance on specific topics. The table below shows results for measurements per topic taught and assessed in the program. The assessment results indicate there is a significant difference in average scores in each topic, with the treatment group outperforming the control group. Those results are summarized in Table 1.
Students who used Blueprint as supplementary mathematics instruction performed better on the Blueprint assessment than students who did not use the program. Program users outperformed non-users overall and on skills assessed in the Blueprint assessment. This study demonstrates that Blueprint may be effective supplemental instruction for students who use the program.
Blueprint is a supplemental, digital math program that teaches foundational mathematical skills for pre-K through grade one students. Blueprint incorporates real-world problems in an engaging virtual world. Early learners connect with Blueprint’s relatable characters and learn from memorable songs that teach fundamental math concepts in a fun, game-like experience. Additionally, students are provided supportive prompts and multiple opportunities for reteaching to ensure encouraging, successful encounters with math. Students are motivated to do their best and complete lessons as they earn tokens for their achievements.