Using AI makes people less likely to admit they don't know something
Jump to main content
Search
REG AD
AI and ML
Using AI makes people less likely to admit they don't know something
Researchers found confidence increased even as accuracy fell
Thomas Claburn
Thomas<br>Claburn
AI AND SOFTWARE REPORTER
Published<br>sun 19 Jul 2026 // 09:01 UTC
In 2026, AI still "hallucinates" and gives you wrong answers a good chunk of the time. Nevertheless, academics from French and Italian universities have found that access to AI advice suppresses critical thinking, making people more likely to confidently parrot incorrect information that the bot provided.<br>"For humans, the capacity to say, 'I don't know,' is very important because it represents the recognition of the limits of our own knowledge," said Valerio Capraro, associate professor at the University of Milano-Bicocca, in a phone interview.<br>"But now with AI, we can get an easy answer to virtually every question, so we wondered whether this would interfere with human capacity to say, 'I don't know,' to suspend judgment."
REG AD
Capraro and co-authors Chiara Marcoccia (École Normale Supérieure) and Walter Quattrociocchi (Sapienza University of Rome) set out to see how access to AI advice affects people's willingness to admit ignorance.
REG AD
The title of their paper reveals their findings: "AI advice suppresses people’s willingness to say 'I don’t know', even when the advice is wrong and accuracy is incentivized."<br>Capraro said that he and his colleagues designed a set of questions where large language models typically fail. In this instance, they asked study participants to answer questions about visual details in films, such as the color of the team's uniform in Bend It Like Beckham or the vehicle Monica drives in Like a Cat on a Highway.<br>The researchers expected these sorts of details would be absent from most model training data, which was the case for the model used in the experiment (Step 3.5 Flash). They also tested recent frontier models (GPT-5.5, Claude Sonnet 4.6, Gemini 3.5 Flash), which missed the vehicle question but often got other details correct.<br>They used Step 3.5 Flash because it was usually wrong, as explained in the paper, so any reduction in judgment could not be explained away as sensible delegation to a reliable tool.<br>"We divided human participants into two groups," explained Capraro. "One group had to answer these questions without AI advice, and another group could ask the AI for advice. What we found is that in the baseline, 44 percent of people responded that they didn't know the answer, so they suspended judgment. With AI advice, only three percent did so. So the judgment suspension collapsed."<br>Capraro said that even more interestingly, accuracy collapsed when AI help was available. In other words, they trusted AI's answer more than their own.<br>"In the baseline, 27 percent of people gave the correct answer," he said. "With AI advice, only nine percent of people gave the correct answer. So some would-be correct people asked for AI advice and became wrong."<br>Also, access to AI advice made people more confident that they were correct. The baseline level was 30 percent, he said, but with AI help, confidence rose to 76 percent. They believed the bots, despite the possibility of hallucinations.
REG AD
"So basically people became much worse – the accuracy was only one third – but they were twice as confident," he said.<br>The researchers also conducted the experiment with monetary incentives, which helped a bit. Willingness to suspend judgment and admit ignorance rose from 3 percent to 8 percent and accuracy rose from 9 percent to 16 percent but was still below the baseline of 44 percent and 27 percent respectively.<br>While the researchers chose questions about film trivia, they contend their findings can be generalized across other domains.
MORE CONTEXT
Mozilla speeds Firefox release schedule to biweekly
Microsoft cuts OneDrive support for older Windows 10 versions next month
Billing software error sends billion-dollar AWS estimates
AI spam filters are getting suckered by old-school text salting
Capraro said that he believes this is an issue that needs to be dealt with at a societal level through AI literacy and education policy initiatives. "Of course model providers should try to help, but I would imagine that the incentives are not very much aligned," he said. "A much more promising approach would be at the educational level."<br>"I'm very much concerned for children, because adults have learned critical thinking. But for children who basically are born with these systems, the risk is that they don't even learn the basic critical skills." ®
ai and ml<br>ai<br>step 3.5 flash<br>llms
REG AD
DEVOPS
Java was a three-day hotfix away from dying horribly on stage
Tim Lindholm, Java's original JVM maintainer, shares with El Reg some of the grungy build details the doc glosses over
SOFTWARE
Mozilla speeds Firefox release schedule to...