The Auditor’s Opinion | I, Cringely

Previous

The Auditor’s Opinion

Last week somebody rebuilt a working website using a swarm of cheap AI agents bossed around by a smarter one, and the whole thing cost about eight dollars —  sandwich and a coffee. But the part that lit up my corner of the internet wasn’t the website. It was that the agents caught their own lies.

One of them went out and collected a couple hundred quotes for the site and reported back that every last one was verified, checked, gold. Another agent — a suspicious little thing that had been told to ignore the first one’s homework and redo it from scratch — went and compared each quote against the actual source. More than a dozen were wrong. Invented. Stitched together from real fragments into sentences nobody had ever said. The checker flagged them, sent them back, and they got fixed. No human touched it. Total additional cost: a rounding error.

The reaction was what you’d expect. Hallucination is solved. It’s handled structurally now. It’s just a recipe — anybody can do this.

And here’s the thing that made me put down my coffee: they’re right. That’s the interesting part. They are completely, verifiably right, and they have drawn precisely the wrong conclusion from being right.

Let me tell you what I think actually happened last week. Then, because a thesis you haven’t tried to strangle in its crib isn’t worth printing, let me spend a few hundred words trying to prove myself wrong.

The thesis, in one sentence

When everybody can check, “we checked” stops meaning anything — and the value doesn’t disappear, it moves to whoever can prove it.

That’s it. That’s the whole argument. Cheap, universal self-checking doesn’t make verification worthless. It makes verification worthless and makes proof of verification more valuable than it has ever been. Those are two different goods, and we are about to spend the next few years confusing them.

I know this because we have run this exact experiment before. Several times. It always ends the same way, and it has never once ended the way the eight-dollar-website people think it’s going to end.

We have done this before

Once upon a time, a company’s books were whatever the company said they were. You wanted to know if a firm was sound, you asked the firm, and the firm told you it was doing marvelously, thank you. This worked exactly as well as you’d imagine. Victorian England ran on railway shares and joint-stock companies that turned out, with some regularity, to be elaborate works of fiction. America capped the genre in 1929.

Now — anybody could add up a ledger. Arithmetic was not a scarce resource. Double-entry bookkeeping had been sitting in print since a Franciscan friar wrote it down in 1494. The capability to check the numbers was cheap and universal and had been for four centuries. And it counted for nothing, because the party doing the adding was the party with everything to gain from the total.

So the market invented a thing. Not new arithmetic — new arithmetic-with-a-signature-on-it. An independent audit, performed by someone who didn’t work for you, who put their name and their liability on an opinion that your books were what you claimed. After 1933 and 1934 we made it the law for anyone who wanted to sell shares to the public. And a strange thing happened to the value: the signature on the auditor’s opinion became worth more than the numbers underneath it. The numbers were free. Everybody had the numbers. What cost money — what still costs a fortune — was the independent, accountable, provable attestation that the numbers were true.

This is not a one-off. It is the most reliable pattern in the history of commerce, and once you see it you can’t stop seeing it.

John Moody couldn’t tell which railroad bonds were safe, and neither could anybody else, so in 1909 he started publishing ratings — a trusted outsider’s letter grade — and built an institution that outlived every railroad he graded. Anyone could read a balance sheet. What you couldn’t do was vouch.

By 1894 American cities were wiring themselves for electricity and quietly burning themselves down, so a young electrical inspector founded a laboratory to test the equipment and stamp the safe ones with a little circled UL. Anyone could wire a lamp. What you couldn’t do was promise a nervous insurer it wouldn’t kill somebody.

Go back further and it’s a notary — a person whose entire job, for two thousand years, has been to be a trusted third party who watches you sign and swears you signed. Come forward and it’s the little padlock in your browser, which exists because somewhere a certificate authority you’ve never heard of vouched that the website is who it says it is. Anyone can make a web page. What you can’t do, standing there yourself, is prove it’s not a trap.

The pattern, every single time, in four beats: a capability gets cheap and universal; self-attestation becomes worthless because it’s cheap and universal; a trusted,...