Cognitive debt is a real organizational risk: Don’t ignore it | Thoughtworks

Enable javascript in your browser for better experience. Need to know to enable it?<br>Go<br>here.

Search

Close

Ask Tai

Cognitive debt is a real organizational risk

Don’t ignore it

Engineering Stack<br>Back

Engineering Stack<br>Back

Close

Generative AI

Blog

By

Matt Kamelman

Published: May 28, 2026

Last year MIT Media Lab published a study  that most enterprise AI conversations are still ignoring: it showed that users who relied on ChatGPT as a primary drafting tool showed 47% reduced neural connectivity compared to those who wrote without AI assistance, with many struggling to recall or quote from the essays they had just produced. The researchers called this phenomenon cognitive debt. The study focused on essay writing, so yes, some caution is warranted before extending its implications across all domains. However, the mechanism it describes is difficult to dismiss.

The most important finding isn’t so much reduced engagement but the fact that participants who first worked through problems themselves and only later used AI showed increased neural connectivity. In other words, the same tool used differently produced the opposite cognitive outcome. Whether humans lead the reasoning and AI refines it or AI leads and humans follow turns out to matter more than whether AI is used at all.

The problem, though, is that most organizations are deciding this question implicitly, at speed, without recognizing it as a decision. They're deciding it through incentive structures that reward visible output — lines of code shipped, documents generated, tickets closed — and lack any instrument for measuring whether the cognitive capacity underneath that output is compounding or eroding.

The AI adoption paradox

The entire cognitive ecosystem begins shifting toward abstraction layers that distance humans from direct engagement with the reasoning process underneath the work. In turn, this creates a paradox at the center of current AI adoption strategies.

Organizations repeatedly describe the coming decade as one in which uniquely human judgment becomes more important, not less. As generative systems commoditize execution, differentiation shifts toward discernment: deciding what matters, what’s true, what’s safe, what’s strategically coherent, what aligns with human values and what should exist at all. But if the era of AI is, above all, becoming the era of judgment, then accumulating cognitive debt may be defeating the very purpose of it.

The same workflows maximizing short-term productivity may also be eroding the cognitive foundations that make that judgment possible.

Delegation vs. collaboration

Practitioner communities are documenting a bifurcation between two modes of AI use: delegation versus collaboration. The distinction isn’t about how much AI is used, but is instead about whether human reasoning precedes it:

In collaboration mode, people formulate hypotheses, structure arguments, identify constraints, and use AI to pressure-test, extend or refine what they have already begun to think.

In delegation mode, AI generates a starting point and the human evaluates, edits or accepts what comes back.

The outputs can look identical for weeks. Margaret-Anne Storey, a professor of computer science at the University of Victoria who studies AI-augmented software teams, documented what the difference looks like when it surfaces: a development team moving fast on AI-generated code hit a wall around week seven or eight of a project. They could no longer make simple changes without breaking something unexpected. When she worked with them, the real problem wasn’t messy code; it was that no one on the team could explain why certain design decisions had been made or how different parts of the system were supposed to work together. The shared understanding of what they were building had dissolved. The code existed but the reasoning behind it did not.

Storey calls this the "erosion of the shared understanding of the system". She argues it could be an even bigger risk than technical debt as AI accelerates development velocity. In the short term, delegation looks like speed; in the long term, it produces organizations that can execute but cannot explain, adapt or course-correct.

An AI adoption program centered around "AI-first" defaults isn’t merely a productivity intervention, it’s also a decision about whether the workforce retains the capacity to think without it.

Matt Kamelman

Innovation Choreographer, Thoughtworks

An AI adoption program centered around "AI-first" defaults isn’t merely a productivity intervention, it’s also a decision about whether the workforce retains the capacity to think without it.

Matt Kamelman

Innovation Choreographer, Thoughtworks

Explanation as instrumentation for cognitive debt

Storey identifies the organizational signals that precede that failure: team members hesitating to make changes for fear of unintended...