American Institutes for Research (AIR) recently released the final report from their independent evaluation of TenMarks Math. The study's findings suggest that TenMarks Math improved average math performance by 0.19 standard deviations on state tests in classes that completed at least one assignment per week during the school year. That translates to an 8 percentile-point gain - from the 50th to the 58th percentile - in the first year of use.
This change implies that a class at the 50th percentile in the state would be at approximately the 58th percentile if it systematically used TenMarks Math during the year.
American Institutes for Research:
The Effect of TenMarks Math on Student Achievement (August 2017)
Impact of TenMarks Math. The graph represents the estimated impact on achievement implied for a class at the 50th percentile of performance on a state's end-of-year assessment. The impact estimate is based on AIR's statistical analysis of test-score trends between classes that completed at least one assignment per week on TenMarks Math for a single school year and a matched set of comparison classes that did not have access to the program. The impact found by AIR is represented in the graph as the difference between the trajectories of the TenMarks Math and comparison groups.
The study assesses the impact of TenMarks Math on student achievement across 10 states. Including a diverse set of states and multiple measures of student achievement helps ensure that the study's findings are broadly applicable. In order to boost internal validity, the study uses a research design called CITS (Comparative Interrupted Time Series), one of the most rigorous quasi-experimental designs for estimating program effects.
(TenMarks Math Implmentations in the Study)
Schoolwide Title 1