Pearson Successmaker Math Efficacy Study 2009-10 Final Report
Pearson Successmaker Math Efficacy Study 2009-10 Final Report Pearson Successmaker Math Efficacy Study 2009-10 Final Report
SuccessMaker Math RCT Gatti Evaluation Inc. 9-15-10standard deviations) and the Process and Applications subtest (i.e., 1.06 to 1.39 standarddeviations). Further, lower-achieving and Hispanic 7 th grade SuccessMaker students statisticallyoutperformed their comparison group peers on the Process and Applications subtest (i.e., 0.58and 1.19 standard deviations).RQ: Do 3 rd , 5 th , and 7 th grade students using the SuccessMaker Math program demonstrate morepositive attitudes toward mathematics and mathematics instruction as their comparison groupcounterparts?The 3 rd and 7 th grade SuccessMaker students both had statistically significantly higher mathacademic attitudes than the comparison group (i.e., 3 rd 0.99 standard deviations, 7 th 0.62 standarddeviations). The very large statistically significant effects seen at 3 rd grade were also seen forHispanic, low SES, non-English proficient, female, and lower-achieving students (i.e., 0.29 to1.13 standard deviations). Several 7 th grade at- risk populations (i.e., female, low SES, non-English proficient) also had statistically higher math attitudes than the comparison group (i.e.,0.61 to 0.69 standard deviations).This summary and its content are proprietary information belonging to Gatti Evaluation Inc.- 4 -
SuccessMaker Math RCT Gatti Evaluation Inc. 9-15-10I. INTRODUCTIONAs elementary and middle schools strive to meet the adequate yearly progress goals set for themin reading and mathematics achievement, many are attempting to maximize their efforts byturning to instructional technology like the SuccessMaker© 1 program. Gatti Evaluationpartnered with Pearson to evaluate the effectiveness of the SuccessMaker program. Informationgathered during this study will inform future revisions of the program and provide evidence ofprogram efficacy.Pearson partnered with Gatti Evaluation to study the efficacy of theSuccessMaker Math program in achieving positive educational attitudes andachievement outcomes.This report provides methods and results from the first phase of the efficacy research conductedduring the 2009-10 school year on the SuccessMaker Math program; including the studymethodology, nuanced program usage information, teacher and administrator attitudes, as well asstudent attitudinal and achievement gains. This efficacy study evaluated the Math program insixty-three diverse 3 rd , 5 th and 7 th grade classrooms from ten schools in seven different states(i.e., AZ, AR, CA, IN, KS, NY, PA).Instructional Technology LiteratureSuccessMaker is an adaptive computer based learning environment that offersan instructional management system, placement and formative assessment,individualized elementary and middle grade reading and mathematicscurriculum resources, and a student progress reporting system.SuccessMaker is an adaptive computer-based learning environment that offers an instructionalmanagement system, placement and formative assessment, individualized elementary and middlegrade reading and mathematics curriculum resources, and a reporting system to informadministrators and teachers as to student progress. It is widely believed that making formativeassessment an integral part of instructional practice is one of the best ways to improve studentlearning. 2 The National Council of Teachers of Mathematics also emphasizes that technologycan enhance mathematics learning and supports effective mathematics teaching and skillspractice. Mathematics education and instruction may be aided by technology in various ways,with the technology assuming the role of enhancing, amplifying, and organizing curricula. 3 It isalso well documented that both the scope of ways and effectiveness of technology in aidinginstruction is increasing with each passing decade. 4 What remains unclear are the best ways to1 http://www.pearsondigital.com/2 National Council of Teaching of Mathematics (2000). Principles and Standards for School Mathematics. Reston, Va.: National Council ofTeachers of Mathematics.3 Heid, M. K. (1997). The technological revolution and the reform of school mathematics. American Journal of Education, 106(1), p5-61.4 Jenks, M. S., & Springer, J. M. (2001). A view of the research on the efficacy of CAI. Electronic Journal for the Integration of Technology inEducation, 1(2).- 5 -
- Page 1 and 2: PEARSON SUCCESSMAKER MATHEFFICACY S
- Page 3 and 4: SuccessMaker Math RCT Gatti Evaluat
- Page 5 and 6: SuccessMaker Math RCT Gatti Evaluat
- Page 7: SuccessMaker Math RCT Gatti Evaluat
- Page 11 and 12: SuccessMaker Math RCT Gatti Evaluat
- Page 13 and 14: SuccessMaker Math RCT Gatti Evaluat
- Page 15 and 16: SuccessMaker Math RCT Gatti Evaluat
- Page 17 and 18: SuccessMaker Math RCT Gatti Evaluat
- Page 21 and 22: SuccessMaker Math RCT Gatti Evaluat
- Page 23 and 24: SuccessMaker Math RCT Gatti Evaluat
- Page 25 and 26: SuccessMaker Math RCT Gatti Evaluat
- Page 27 and 28: SuccessMaker Math RCT Gatti Evaluat
- Page 29 and 30: SuccessMaker Math RCT Gatti Evaluat
- Page 31 and 32: SuccessMaker Math RCT Gatti Evaluat
- Page 33 and 34: SuccessMaker Math RCT Gatti Evaluat
- Page 35 and 36: SuccessMaker Math RCT Gatti Evaluat
- Page 37 and 38: SuccessMaker Math RCT Gatti Evaluat
- Page 39 and 40: SuccessMaker Math RCT Gatti Evaluat
- Page 41 and 42: SuccessMaker Math RCT Gatti Evaluat
- Page 43 and 44: SuccessMaker Math RCT Gatti Evaluat
- Page 45 and 46: SuccessMaker Math RCT Gatti Evaluat
- Page 47 and 48: SuccessMaker Math RCT Gatti Evaluat
- Page 49 and 50: SuccessMaker Math RCT Gatti Evaluat
- Page 51 and 52: SuccessMaker Math RCT Gatti Evaluat
- Page 53 and 54: SuccessMaker Math RCT Gatti Evaluat
- Page 55 and 56: SuccessMaker Math RCT Gatti Evaluat
- Page 57 and 58: SuccessMaker Math RCT Gatti Evaluat
SuccessMaker <strong>Math</strong> RCT Gatti Evaluation Inc. 9-15-<strong>10</strong>I. INTRODUCTIONAs elementary and middle schools strive to meet the adequate yearly progress goals set for themin reading and mathematics achievement, many are attempting to maximize their efforts byturning to instructional technology like the SuccessMaker© 1 program. Gatti Evaluationpartnered with <strong>Pearson</strong> to evaluate the effectiveness of the SuccessMaker program. Informationgathered during this study will inform future revisions of the program and provide evidence ofprogram efficacy.<strong>Pearson</strong> partnered with Gatti Evaluation to study the efficacy of theSuccessMaker <strong>Math</strong> program in achieving positive educational attitudes andachievement outcomes.This report provides methods and results from the first phase of the efficacy research conductedduring the <strong>2009</strong>-<strong>10</strong> school year on the SuccessMaker <strong>Math</strong> program; including the studymethodology, nuanced program usage information, teacher and administrator attitudes, as well asstudent attitudinal and achievement gains. This efficacy study evaluated the <strong>Math</strong> program insixty-three diverse 3 rd , 5 th and 7 th grade classrooms from ten schools in seven different states(i.e., AZ, AR, CA, IN, KS, NY, PA).Instructional Technology LiteratureSuccessMaker is an adaptive computer based learning environment that offersan instructional management system, placement and formative assessment,individualized elementary and middle grade reading and mathematicscurriculum resources, and a student progress reporting system.SuccessMaker is an adaptive computer-based learning environment that offers an instructionalmanagement system, placement and formative assessment, individualized elementary and middlegrade reading and mathematics curriculum resources, and a reporting system to informadministrators and teachers as to student progress. It is widely believed that making formativeassessment an integral part of instructional practice is one of the best ways to improve studentlearning. 2 The National Council of Teachers of <strong>Math</strong>ematics also emphasizes that technologycan enhance mathematics learning and supports effective mathematics teaching and skillspractice. <strong>Math</strong>ematics education and instruction may be aided by technology in various ways,with the technology assuming the role of enhancing, amplifying, and organizing curricula. 3 It isalso well documented that both the scope of ways and effectiveness of technology in aidinginstruction is increasing with each passing decade. 4 What remains unclear are the best ways to1 http://www.pearsondigital.com/2 National Council of Teaching of <strong>Math</strong>ematics (2000). Principles and Standards for School <strong>Math</strong>ematics. Reston, Va.: National Council ofTeachers of <strong>Math</strong>ematics.3 Heid, M. K. (1997). The technological revolution and the reform of school mathematics. American Journal of Education, <strong>10</strong>6(1), p5-61.4 Jenks, M. S., & Springer, J. M. (2001). A view of the research on the efficacy of CAI. Electronic Journal for the Integration of Technology inEducation, 1(2).- 5 -