What researchers studied

Psychometric analysis of publicly available item-level data from Massachusetts English language arts assessments administered from 2001 through 2023. 3,570 publicly released English language arts items from statewide assessments in Grades 3 through 8 and Grade 10, paired with student item-response data

What they found

  • Researchers coded an average of 19 percent of released items as measuring higher-order thinking, with no grade-year assessment reaching 50 percent.
  • The assessment data generally supported a single overall English language arts construct rather than cleanly separable higher-order and lower-order scores.
  • Some pre-Common Core grade-years allowed the two types of skill to be distinguished, while the newer Common Core-aligned exams contained more demanding items but were harder to split into separate subscores.
  • Foundational skills remained strongly related to later educational attainment and appeared necessary for students to demonstrate more complex thinking.

What the study does not prove

  • The study evaluated measurement, not an instructional program, and did not estimate whether a particular teaching method improves higher-order thinking.
  • The data came from Massachusetts English language arts exams and may not generalize to other states, subjects, or assessments.
  • Nearly 46 percent of Grades 3 through 8 items from 2009 through 2023 were not publicly released and therefore could not be coded.
  • The analysis shows whether the available scores can distinguish constructs, not everything an individual student can do in authentic classroom work.

Evidence strength: Extensive psychometric analysis across two decades of statewide assessment data, with strong scope for measurement questions and important subject, state, and item-release limits.

Why this matters for families

If the score looks strong but complex assignments still fall apart, look beyond the number. Ask the student to explain, connect evidence, and transfer knowledge to a new problem.

Noor interpretation

How Noor translates the evidence into practice

A standardized score is useful, but it should not be treated as a complete picture of reasoning. Families need evidence from the student's explanations, written work, problem solving, and response to feedback.

Noor Lyra can use assessment results as one signal while examining how a student reasons through unfamiliar work. Noor should not claim that state tests are invalid or that its own review replaces formal assessment.

Read the original source

Noor links to the original or authoritative source so families can distinguish the evidence itself from our interpretation.

Open original source →

DOI: 10.26300/asn1-ev31

Research notes

assessmentcritical thinkingEnglish language artslearning sciencecollege readiness

No single study determines a student's plan. Noor uses research as one input alongside the learner's goals, observed performance, academic context, and response to instruction.