LLMs for theory-building - by Gordon Brander

SubscribeSign in

LLMs for theory-building<br>Can AI do abductive reasoning?

Gordon Brander<br>Aug 11, 2026

10

Share

Three kinds of reasoning:<br>Deductive : All beans in this bag are white. These beans are from this bag. Therefore these beans are white. (Rule + Case → Result)

Inductive : These beans are from this bag. They are white. Maybe all beans in this bag are white? (Case + Result → Rule)

Abductive : All beans in this bag are white. These beans are white. Maybe they came from this bag? (Rule + Result → Case)

Deduction proves, induction generalizes, abduction explains. Or, put another way, abductive reasoning tries to match an observation to the best available hypothesis that could explain it.

Henri-Edmond Cross, 1904. “The Artist’s Garden at Saint-Clair”<br>LLMs are not very good at abductive reasoning. They aren’t great at deduction either, but we can patch this up with tool use, with automated reasoning, and by burning more thinking tokens.<br>Where LLMs truly shine is inductive reasoning. This is surprising, because before we had LLMs, computers were not inductive at all. Software was rigid, procedural, literal, deductive in nature. But LLMs are intuitive, like us. This is what makes them seem so human!<br>System 1 excels in constructing the best possible story based on ideas currently activated and it does not (cannot) allow for information it does not have. When information is scarce, which is a common occurrence, System 1 operates as a machine for jumping to conclusions.<br>-Daniel Kahneman, “Thinking, Fast and Slow”

Well but so, if LLMs are good at induction, and they can be made to do deduction, can they also be coached into abductive reasoning? This matters, because abductive reasoning is a core move in theory-building, debugging, and discovery. It goes like this:<br>You encounter something surprising that violates your current model of reality

Suddenly–eureka!—a mechanism pops into your head which explains it (abductive).

You figure out what else would be true if the theory were to hold (deductive)

Then you test empirically to gather evidence (inductive).

Abductive reasoning gets us from epicycles to elliptical orbits. It’s where new ideas come from. If an LLM can do all three kinds of reasoning, we have the raw ingredients for fully-automated research.<br>I also have a stake in this, because abductive reasoning is an important part of strategic foresight. Scenario planning isn’t just about predicting discrete events. It’s a theory-building exercise.<br>Systems fool us by presenting themselves as a series of events.<br>-Donella Meadows

We want to form a theory of why events are happening. This is what makes the foresight strategic. In a way, Deep Future is a bet that LLMs can be made to do abductive inference. But how?

Hang on, what about all those math breakthroughs LLMs have been making? These seem to be examples of abductive reasoning. Very interesting…<br>It seems notable that the fastest advances are happening in formal and verifiable domains such as math and coding. Might the constraints of mathematics make abductive reasoning more tractable?<br>Another clue: when solving these math problems, the LLM seems to take a lot of shots in the dark, just trying a lot of things and checking the results. This is sometimes called “repeated sampling” or “test-time compute scaling” in the lit. It sort of brute-forces abductive reasoning, but hey compute is cheap, so why not? Take 100 guesses. Take 1000 guesses. Who cares?<br>This may indicate one way that AI systems have an edge: it’s not just that they can try all known methods, but they can play for longer and in more treacherous waters than mathematicians without getting overwhelmed. Of course this is not yet robustly true, but this may be a foreshadowing event.<br>(Jacob Tsimerman et al in “Remarks on the disproof of the unit distance conjecture”, 2026)

This goes some way toward explaining why formally verifiable domains are getting automated first. The LLM vibes out a bunch of tests, the compiler verifies them. So inductive reasoning can simulate abductive reasoning by generating enough data points to hit on a solution, or to curve-fit.

What about non-verifiable domains? Funnily enough, training LLMs in verifiable domains like code seems to make them better at reasoning in general. It is as though the logical structure of if-else statements cultivates good thinking habits which transfer over to other contexts. As a programmer, this makes sense to me. I’m very vibey by disposition, but learning to code did make me more of a robot in some useful ways.<br>Beyond transfer learning, LLM-as-judge can be surprisingly effective. The LLM judge acts as a substitute verifier in domains without any formal verification method. Anthropic managed to scale this all the way to bootstrapping Claude with Constitutional AI. It also works pretty well at inference time, allowing LLMs to apply their shotgun guessing approach to squishier domains....