Inside the Roadmaps Impact Study: Using Data to Validate What Works — and Inform How You Teach

Schools participate in an Impact Study to gain deeper insight into how their instructional strategies, using Teach to One Roadmaps, translate into measurable student growth. But what exactly is an Impact Study? It’s a collaborative research partnership between a school and Teach to One designed to examine how student performance in Roadmaps aligns with external measures of academic progress. By analyzing Roadmaps student-level data alongside third-party assessments—like state exams or MAP Growth—the Impact Study shows how personalized learning translates into outcomes on trusted benchmarks. Because Roadmaps tracks each student’s demonstrated math skills and progress toward proficiency, the analysis shows how time spent in Roadmaps and completing skills leads to evidence of real learning. These studies not only reveal the true impact of personalized learning, but also spark valuable conversations among educators, support professional development, and strengthen collaboration, helping your school turn evidence into action and continuous improvement.

Why Participate in an Impact Study?

Schools use Impact Studies to:

• Showcase data-driven outcomes as part of your school’s commitment to innovative, evidence-based instruction.
• Validate how student progress in Roadmaps aligns with your district’s measures of academic achievement, both as an ongoing indicator throughout the year and as a tool to drive continuous improvement.
• Share actionable, data driven results with teachers and administrators to identify opportunities to improve instructional practices.

Data Requirements

We’ll need student-level results from an external measure of academic success—such as MAP scores, state assessments, or other trusted progress indicators. We then align those results with skill-proficiency data from Teach to One Roadmaps to explore how they relate. However, Roadmaps is just one component of a student’s entire educational experience. Any additional student level data you can provide helps us better understand the true influence of Roadmaps within this broader context, such as:

• Student demographics
• Background indicators 
• Insights, thoughts or theories you have about factors contributing to student success

Most importantly, data safety is our top priority. New Classrooms is SOC 2 compliant, meeting the highest standards for security and privacy. Our secure, encrypted data portals make sharing information easy and safe, and we’re always happy to work with your district’s preferred data-sharing procedures.

Methodology

Our approach is built to ensure that every school receives clear, actionable insights. The strength of our analysis grows with the data we receive. No matter the scenario, our goal is to always fairly identify whether a data-driven, statistically significant relationship exists between Roadmaps usage and measures of student achievement. 

We use different research methods based on your school’s data and context:

• Simple comparisons (like a two-sample t-test) which validates whether students who use Roadmaps more achieve different results than those who use it less.
• Regression analysis to look for patterns and control for factors like classroom environment or student background.

Whenever possible, we use a matched analysis to:

• pair students with similar backgrounds and experiences, differing only in their level of Roadmaps engagement.
• help us see the true impact of Roadmaps as accurately as possible.

If your school doesn’t have enough students for matched analysis, we still provide meaningful results using other robust statistical techniques.

What the Methodology Means

We want to clearly show the impact of Roadmaps on student learning. By comparing similar groups of students, where the main difference is their use of Roadmaps, we can provide results that truly reflect its effect, giving your school actionable insights you can trust.

Ready to Get Started?

If you’re interested in bringing an Impact Study to your school, share the Impact Study Flyer with your team to begin the conversation!

About the Author

Mat Johnson explores how data can drive student growth and learning at New Classrooms. His work focuses on evaluating progress within Teach to One Roadmaps and understanding how that growth connects to success in the classroom and beyond. Before joining New Classrooms two years ago, Mat spent five years analyzing financial data and earned his Master’s in Data Science from the University of Rochester in 2023.