Opinion | AI transparency law for CA government was bound to fail

About<br>Newsletters

Search

CalMatters is your nonprofit and nonpartisan newsroom dedicated to explaining how state government impacts our lives.

“CalMatters is a breath of fresh air for my eyes and for my critical thinking.” —CalMatters member Gordon of Bakersfield

Politics

Immigration

Housing

Education

Economy

Environment

California Voices

Investigations

Impact

Events

A state agency office in downtown Sacramento on July 15, 2026. Photo by Miguel Gutierrez Jr., CalMatters

Welcome to CalMatters, the only nonprofit newsroom devoted solely to covering statewide issues that affect all Californians. Sign up for WeeklyMatters for a Saturday morning digest of the latest news and commentary from the Golden State.

This story is part of California Voices, a commentary forum aiming to broaden our understanding of the state and spotlight Californians directly impacted by policy or its absence. Learn more here.

Guest Commentary written by

Victoria Copeland

Victoria Copeland is a research fellow at the UCLA Center on Resilience and Digital Justice.

Stevie Glaberson

Stevie Glaberson is the director of research and advocacy for the Center on Privacy and Technology at Georgetown Law.

After announcing under a new law that California’s state government uses no so-called high-risk AI systems, the state has discovered — to no one’s surprise — that state agencies actually have been using at least six automated systems to make consequential decisions about the lives of Californians.

Systems like these mine sensitive personal data to automate what can be life-and-death government decisions for people, such as whether they will be granted cash assistance to feed their families, qualify for housing or be able to access needed medical care.

This episode exemplifies something many have long argued: Regulating technology through transparency will fail not only to spark significant change but even to meet the already low threshold of letting the public know what the government is up to.

Assembly Bill 302, which was signed three years ago, requires the state’s Department of Technology to conduct a “comprehensive inventory of all high-risk automated decision systems” proposed or used by “any state agency” and to publish a yearly report on its findings.

In 2025, following the department’s first report (finding no high-risk systems), we made a public records request for the department’s data. What we received back was laughable: a single spreadsheet with a column labeled “Is ADS used” and the word ‘no’ listed for each agency.

There was no evidence of any further technology department inquiry.

This year, the department interviewed a few agencies that finally raised their hands to say they used high-risk systems. That means AB 302 depends wholly on agencies to self-report, and there’s no process to verify an agency’s claims — nor any repercussions for agencies that fail.

READ NEXT

Politics

California admits using high-risk AI — including systems it failed to report last year

by Khari Johnson

Worse, it’s unclear what systems the state believes it is responsible for disclosing. The technology department’s report implies that the decision on whether a system is “high risk” and reportable relies on how state agencies define their own tools.

AB 302 vaguely states that high-risk systems “assist or replace human discretionary decisions that have a legal or similarly significant effect, including decisions that materially impact access to, or approval for, housing or accommodations, education, employment, credit, health care, and criminal justice.” But known systems like the Uniformity Assessment System, for example, which has led to the reduction of In-Home Supportive Services for disabled Californians, and the Risk Segmentation, Stratification, and Tier model used to predict Medi-Cal recipients’ "risk" and “service underutilization,” were not reported.

Transparency bills nationwide have similarly failed. New York’s Public Oversight of Surveillance Technology Act was “meant to provide the public with a better picture into the NYPD’s unchecked use of spying technologies,” according to the Brennan Center for Justice. But NYPD’s Inspector General and outside groups have shown that the police department exploits legal loopholes to avoid scrutiny of technologies, like those creepy robot dogs, and describes its own policies and capabilities in vague terms that undermine any meaningful oversight.

Many jurisdictions have also tried "community control over police surveillance" bills which — like AB 302 — require police to disclose information about their own tech, to similar frustration. Community control strategies allow police to frame surveillance in favorable terms. That can have problematic anchoring effects as policymakers “fixate on whatever instantiation of technology” proponents “happen to put in front of them,” as University of Washington law...