The Arizona State Study: What Independent TAC Testing Found

Written by Craig "The Water Guy" Phillips

The Arizona State study's independent TAC testing found no systemic evidence that high-stakes testing actually improved student learning across 25 states. Researchers measured accountability pressure through 300+ graduate student portfolio comparisons, then checked results against NAEP data. Score gains often traced back to student exclusions or narrow test prep, not real learning. SAT, ACT, and AP scores frequently dropped after graduation exams launched. There's much more to uncover about what these findings mean for policy.

• The Arizona State study examined high-stakes testing policies across 18–28 states, analyzing whether accountability pressure produced genuine student learning gains.
• Independent NAEP data revealed no meaningful relationship between accountability pressure and achievement in math or reading across studied states.
• Score gains on state tests were often traced to exclusion manipulation, narrowed curricula, and test preparation rather than real learning.
• SAT, ACT, and AP results frequently declined after states introduced graduation exams, undermining claims of improved student competency.
• Researchers concluded high-stakes testing policies failed to build lasting competency, recommending reduced stakes and transparent exclusion reporting.

What High-Stakes Testing Policies the Arizona State Study Examined

When we talk about high-stakes testing, we're talking about tests with real consequences — and that's exactly what the Arizona State studies zeroed in on. These weren't low-stakes assessments gathering dust in a filing cabinet. We're talking about exit and graduation exams, grade-promotion tests, and accountability systems tied directly to rewards and sanctions.

The researchers examined these policies across 18 to 28 states, depending on the specific study version. That's a substantial cross-section, giving us real comparative power. They also factored in implementation details — things like exclusion rates, shifts in test participation, and when each state actually adopted its policies. That attention to nuance matters. It's what separates a rigorous analysis from a surface-level comparison, and it's why these findings deserve serious attention.

How Researchers Measured Accountability Pressure Across 25 States

They built documentary portfolios for all 25 states, then had over 300 graduate education students compare pairs of portfolios using the law of comparative judgments. Each rater reviewed one pair. That structured process produced something genuinely powerful:

Over 300 graduate students compared real policy portfolios — pair by pair — to measure what accountability actually looks like.

1. A pairwise judgment matrix capturing real human evaluations of real policy evidence
2. A scaled continuum ranking every state from high to low accountability pressure
3. Quantitative pressure scores usable in regression and correlation analyses against NAEP outcomes

This wasn't a checklist. It was an aggregated, evidence-grounded measurement system — one that let researchers ask, with precision, whether pressure actually moved student achievement.p>

What the Results Revealed About High-Stakes Testing and Student Learning

After all that rigorous measurement work, what did the results actually show? Across 18–28 states and four independent measures—NAEP, SAT, ACT, and AP—the TAC researchers found no systemic evidence that high-stakes testing actually increased student learning.

NAEP data showed no meaningful relationship between accountability pressure and later cohort achievement in math or reading. SAT, ACT, and AP results often declined after states introduced graduation exams. Where scores did rise, the gains traced back to test preparation, student exclusions, or shifting participation rates—not genuine, transferable learning.

That distinction matters enormously. Score gains and learning gains aren't the same thing. The TAC team concluded these policies had failed as a strategy for building real, lasting student competency—and urged us to stop confusing one for the other.p>

Why Score Gains Didn't Reflect Real Achievement

So if scores went up in some states, why didn't that count as real progress? Because the gains didn't hold up under scrutiny. Here's what the TAC/ASU comparisons actually revealed:

1. Exclusion manipulation — Score improvements often tracked changes in who was tested, not how well students learned.
2. Teaching to the test — Curricula narrowed dramatically, inflating scores without building transferable skills.
3. No NAEP transfer — State test gains frequently disappeared when measured against independent NAEP cohort data.

We're talking about a system that rewarded the appearance of progress over actual mastery. When fourth- and eighth-grade NAEP math scores stayed flat while state scores climbed, that disconnect told us everything. Real learning leaves fingerprints across multiple measures. These gains didn't.

Should High-Stakes Testing Policy Change After These Findings?

Given what we've uncovered, the question isn't whether high-stakes testing policy should change—it's how quickly we're willing to act on the evidence.

Across 18–28 states, we saw declining SAT, ACT, and AP outcomes after exit-exam adoption.

We saw exclusion rates masking true performance. That's not accountability—that's theater.p>

So what should replace it? We recommend reducing high-stakes consequences, mandating zero-exclusion NAEP participation, and requiring transparent reporting of exclusion data.

We should invest in teacher-designed, standards-aligned assessments and audit aggressively for test-prep manipulation.

Where genuine gains appeared—specific subgroups, narrow conditions—we should pilot targeted interventions before scaling anything statewide.

The evidence demands precision, not sweeping mandates. Let's reallocate resources toward instruction that actually moves learning forward.

Frequently Asked Questions

What Is the State Testing for Students in Arizona?

We use AzMERIT and other state assessments to measure students' reading, math, and science skills across grades 3–8 and high school, driving critical decisions like promotion, graduation eligibility, and school accountability ratings.

Why Does AZ Rank so Low in Education?

Arizona ranks low because high-stakes testing hasn't improved actual learning—it's narrowed curricula, encouraged teaching to the test, and skewed participation rates, masking real achievement gaps rather than closing them.

What Is the Azmerit Test?

AzMERIT is Arizona's annual standardized test measuring student proficiency in English and math for grades 3–8 and grade 11, helping us understand how well students meet college- and career-ready standards.

Which State Passed a Law That Banned All Classes With an Ethnic Studies Emphasis?

Arizona's the state we're looking at—it passed HB 2281 in 2010, banning public school courses promoting ethnic solidarity or designed primarily for students of a specific ethnic group.