Inside the Roadmaps Impact Study: Using Data to Validate What Works — and Inform How You Teach
November 17, 2025
By Mat Johnson
Schools participate in an Impact Study to gain deeper insight into how their instructional strategies, using Teach to One Roadmaps, translate into measurable student growth. But what exactly is an Impact Study? It’s a collaborative research partnership between a school and Teach to One designed to examine how student performance in Roadmaps aligns with external measures of academic progress. By analyzing Roadmaps student-level data alongside third-party assessments—like state exams or MAP Growth—the Impact Study shows how personalized learning translates into outcomes on trusted benchmarks. Because Roadmaps tracks each student’s demonstrated math skills and progress toward proficiency, the analysis shows how time spent in Roadmaps and completing skills leads to evidence of real learning. These studies not only reveal the true impact of personalized learning, but also spark valuable conversations among educators, support professional development, and strengthen collaboration, helping your school turn evidence into action and continuous improvement.
Why Participate in an Impact Study?
Schools use Impact Studies to:
- Showcase data-driven outcomes as part of your school’s commitment to innovative, evidence-based instruction.
- Validate how student progress in Roadmaps aligns with your district’s measures of academic achievement, both as an ongoing indicator throughout the year and as a tool to drive continuous improvement.
- Share actionable, data driven results with teachers and administrators to identify opportunities to improve instructional practices.
Data Requirements
We’ll need student-level results from an external measure of academic success—such as MAP scores, state assessments, or other trusted progress indicators. We then align those results with skill-proficiency data from Teach to One Roadmaps to explore how they relate. However, Roadmaps is just one component of a student’s entire educational experience. Any additional student level data you can provide helps us better understand the true influence of Roadmaps within this broader context, such as:
- Student demographics
- Background indicators
- Insights, thoughts or theories you have about factors contributing to student success
Most importantly, data safety is our top priority. New Classrooms is SOC 2 compliant, meeting the highest standards for security and privacy. Our secure, encrypted data portals make sharing information easy and safe, and we’re always happy to work with your district’s preferred data-sharing procedures.
Methodology
Our approach is built to ensure that every school receives clear, actionable insights. The strength of our analysis grows with the data we receive. No matter the scenario, our goal is to always fairly identify whether a data-driven, statistically significant relationship exists between Roadmaps usage and measures of student achievement.
We use different research methods based on your school’s data and context:
- Simple comparisons (like a two-sample t-test) which validates whether students who use Roadmaps more achieve different results than those who use it less.
- Regression analysis to look for patterns and control for factors like classroom environment or student background.
Whenever possible, we use a matched analysis to:
- pair students with similar backgrounds and experiences, differing only in their level of Roadmaps engagement.
- help us see the true impact of Roadmaps as accurately as possible.
If your school doesn’t have enough students for matched analysis, we still provide meaningful results using other robust statistical techniques.
What the Methodology Means
We want to clearly show the impact of Roadmaps on student learning. By comparing similar groups of students, where the main difference is their use of Roadmaps, we can provide results that truly reflect its effect, giving your school actionable insights you can trust.
Ready to Get Started?
If you’re interested in bringing an Impact Study to your school, share the Impact Study Flyer with your team to begin the conversation!
About the Author
Mat Johnson explores how data can drive student growth and learning at New Classrooms. His work focuses on evaluating progress within Teach to One Roadmaps and understanding how that growth connects to success in the classroom and beyond. Before joining New Classrooms two years ago, Mat spent five years analyzing financial data and earned his Master’s in Data Science from the University of Rochester in 2023.
Latest Posts
Celebrating Progress at Mid-Year: How I Reset and Refocus With My Students
Mid-year is one of my favorite times to pause and reset in the classroom. By this point in the school year, we have momentum, but it is also a time when students (and honestly, teachers too) can benefit from a chance to reflect, refocus, and build energy for what comes next. For me, this is when I revisit expectations, help students look at their progress, and set the tone for a strong next stretch of learning. In my sixth grade math classroom, celebrating progress is a big part of that. It is not something we save for the end. It is how we keep students motivated and moving forward all year long.
My Seven Bosses and their Sixth-Grade Teacher
Our Research and Development team working on Teach to One Roadmaps at New Classrooms has had, admittedly, some crazy ideas. I tend to get a lot of latitude, but I’ve recently been subjected to weekly performance reviews where I’m told, multiple times, that my work isn’t good enough.
Building a Culture of Engagement Through Student Agency
Our middle school in the Bronx is always striving to be a place where students can take ownership of their own learning. Often in education, words such as “engagement” and “agency” are just overused buzzwords—but at the South Bronx Early College Academy (SBECA), we believe this mindset is crucial for adolescent learning.
