What researchers studied

Quasi-experimental staggered difference-in-differences analysis of state-level policy adoption. A balanced state-year panel using fourth-grade NAEP reading outcomes from 2003 through 2024

What they found

  • The preferred average treatment estimate was 0.33 NAEP points and was not statistically significant.
  • The preferred event-study model found no immediate gain, followed by positive estimates of 2.82 points four years after adoption and 2.68 points five years after adoption.
  • More coordinated and higher-strength policy environments were associated with larger estimates than isolated policy components, although these bundle comparisons remain observational.

What the study does not prove

  • The study measured state policy adoption rather than the fidelity or quality of district and classroom implementation.
  • Results varied across staggered-adoption estimators, and the preferred average effect was not statistically significant.
  • Policy adoption overlapped with other reforms and pandemic-era disruption.
  • Only a limited number of states contributed long post-adoption exposure, and subgroup estimates were imprecise.
  • State-level NAEP outcomes cannot establish what happened to an individual student.

Evidence strength: Moderate. The study uses modern quasi-experimental methods and long-running national assessment data, but the average estimate is imprecise, estimator choice matters, and implementation is not directly observed..

Why this matters for families

When a school adopts a new reading approach, ask what changed in daily instruction, how progress is measured, and what support begins before a child falls further behind.

Noor interpretation

How Noor translates the evidence into practice

A policy label is not instruction. The most credible pattern is that system change may require several years of coordinated implementation before measurable state-level gains appear.

Connect reading goals to explicit instruction, diagnostic evidence, deliberate practice, and progress monitoring. Protect continuity long enough to observe whether the sequence is working.

Read the original source

Noor links to the original or authoritative source so families can distinguish the evidence itself from our interpretation.

Open original source →

DOI: 10.26300/dbg1-p217

Research notes

science of readingliteracy policyNAEPreading instructioneducation research

No single study determines a student's plan. Noor uses research as one input alongside the learner's goals, observed performance, academic context, and response to instruction.