California colleges spend millions on faulty AI systems: 'The chatbot is outdated’ – The Markup

Skip navigation

California colleges spend millions on faulty AI systems: 'The chatbot is outdated’

By Martin Romero

March 7, 2026 8:00 a.m. UTC

Viewable online at<br>https://themarkup.org/machine-learning/2026/03/07/california-colleges-spend-millions-on-faulty-ai-systems-the-chatbot-is-outdated

Share This Article

Copy Link

Republish

The Markup, now a part of CalMatters, uses investigative reporting, data analysis, and software engineering to challenge technology to serve the public good. Sign up for Klaxon, a newsletter that delivers our stories and tools directly to your inbox.

California community college districts are spending millions of dollars on artificial intelligence-powered chatbots intended to help students navigate admissions, financial aid and campus services.

However, they struggle to consistently provide clear and accurate answers, leaving students frustrated and seeking help from others on unofficial social media channels.

In testing by The Markup and CalMatters, they often answered general questions correctly but struggled with more specific ones. East Los Angeles College’s bot couldn’t even correctly name its own president.

Contracts for these chatbots can be pricey and last for years. Three community college districts that responded to a Markup and CalMatters survey reported annual costs ranging from about $151,000 to nearly half a million dollars. At the Los Angeles Community College District, the state’s largest community college system, contracts and amendments approved since 2021 total about $3.8 million through 2029, according to district board documents.

Community college districts that responded to The Markup and CalMatters have contracted with chatbot platforms such as Gravyty and Gecko, which district officials say handle thousands of conversations each month, many outside regular office hours, helping to reduce calls and save students unnecessary trips to campus.

Some of these chatbot platforms rely on manually maintained libraries of frequently asked questions and campus websites to answer questions, which can lead to errors when information is outdated or questions fall outside the system’s database.

However, officials are working to improve them. Districts like the Santa Monica Community College District have moved to ChatGPT-integrated AI systems that scrape the college’s website to generate answers, which officials say seem more reliable. In the Los Angeles district, officials say they plan to transition to a new AI chatbot platform as early as late spring.

↩︎ link<br>Looking for answers

Improvements to the chatbot couldn’t come soon enough for students like Pablo Aguirre, a computer science major at East Los Angeles College and an information technology intern at the Los Angeles college district office.

Aguirre mostly avoids the chatbot himself because, he said, it might provide unreliable or outdated information. He recalled using the bot to find financial aid information, but said he gave up after it kept asking him questions instead of giving him a clear answer.

“I just didn’t find it as useful,” Aguirre said. He usually turns to Google, social media platforms like Reddit and the college’s website when looking for answers.

“Online, some pages don’t work,” Aguirre said, recalling a 404 error message on the college’s website. Even when pages load, he said, it can be difficult to find the right one, such as when he was trying to figure out where to sign up for Extended Opportunity Programs and Services, a state-funded program that supports disadvantaged students. “That’s where I just jump on Reddit,” he said.

Caption:<br>Students walking onto campus at Fresno City College on Oct. 3, 2022.<br>Credit:Larry Valenzuela, CalMatters/CatchLight Local

Aguirre’s experience isn’t unique. Reanna Carlson, a commercial music major at Fresno City College and student government vice president, said her college’s chatbot, dubbed Sam the Ram after its mascot, repeatedly gave her unclear or incorrect answers to basic questions about campus services. Her district, the State Center Community College District, has a nearly $870,000, three-year contract for Gravyty, formerly Ocelot, through June 20, 2026, according to district board documents. Officials pointed out that the contract comes with other services, including tools that let staff engage in live chats or send text messages to students.

“I think the chatbot is outdated and can’t navigate the services we provide on campus effectively,” Carlson said. “I don’t think it’s the most beneficial option when it comes to asking questions.”

Oddly, Carlson got accurate information on the availability of free food at her campus’ Ram Pantry only when accidentally adding a typo to her query. Repeated Markup and CalMatters testing confirmed the same outcome, though the bot sometimes lists links that include the food pantry after clicking an...