When Content Costs Nothing - The Steel Mill

The Steel Mill

SubscribeSign in

When Content Costs Nothing<br>Truth in a world of cheaply generated deepfakes

The Steel Mill<br>Jun 02, 2026

Share

Knowledge has traditionally been gatekept by a small number of journalists, scientists and politicians that could communicate broadly with the public. This was primarily a logistics issue. Sure, anyone could have their own opinions, and borrow books from the local library. But if you wanted to share your ideas beyond the dinner table, it generally required some kind of institutional backing or accreditation. These constraints led to an era defined by institutional power, with much power being concentrated in media and academic gatekeepers. Over time, new technologies, such as writing, the printing press and the internet, have continuously made it easier to disseminate information.<br>With the internet came a wave of influencers, thinkers (and grandparents on WhatsApp) that could share their ideas more broadly. This reduced the influence of the established sources and allowed for more dissent and contrarianism. Undoubtedly the impact of the internet in how information is shared and verified has been huge, though it’d be hard to find consensus as to whether this impact has been net positive or negative. It increased the ability of whistleblowers and marginalized people to share their challenges, though some say it’s led to polarization, mental health issues and the spread of misinformation.<br>Thanks for reading! Subscribe for free to receive new posts and support my work.

Subscribe

However, this trend, of increasing ease of communication, may finally be saturating as the most powerful people in the world can (and sometimes do) communicate with billions of people from atop their toilet seat. We have, of course, benefited immensely from the ease at which ideas could be communicated. This ease has enabled closer interpersonal relationships, easier access to information and lots of scientific progress. Though, as we will undoubtedly discover, easy communication combined with a massive increase of content will have idiosyncratic effects.<br>Thus far, every technological advance has been constrained by a tight bottleneck in that for any message to be communicated and spread, it required significant labour and human capital to craft said message. What that means is that the very act of reading something necessitated that significant time went into creating it, and that necessity acts as a filter preventing the most unhinged or useless sentences from being written to begin with. Newspapers may not have been elixirs of truth; however, you knew that if you were reading something that someone, somewhere thought it worthwhile to write it, and had the ability, funding and backing required to disseminate it to you. This filter has been collapsing for years, as we’ve made it easier to share ideas, even without the “proper” credentials. Today, this trend is accelerating dramatically as the cost of creating content collapses to near zero.<br>LLMs can generate text, audio, and video with increasing quality. Risks of technological addiction aside, this glut of content has massive implications as to the spread of disinformation and will change how people decide what to believe. Not only does the vast amount of generated content make it more difficult to know what is true, it also makes it considerably easier to dismiss quality content as fake. Already we’re overwhelmed by the vastness of information to be consumed online. People grapple with the difficulty of discerning what can be trusted when so much conflicting information is out there. This is Brandolini’s law on steroids. Most people will always resort to their pre-existing beliefs and tribal affiliations, even when they try to expand their horizons, though we need good methods for when we are, in fact, optimizing for truth. What happens when the amount of content multiplies by 10, 102, 103, 10x? And what happens when this content is designed to trigger our emotions, beliefs, or trigger certain actions in the real world?<br>Deepfakes, when they proliferate, by default lead to a low trust world with conflicting information emerging from different sources and no obvious way for people to determine what is actually true. Mitigating this risk is tough. Any centralized efforts to determine truth will be faulty and is unlikely to be fully embraced. Technological solutions, like watermarking technology or AI detectors are undermined by open-source AI, and the fact that many are unable or unwilling to determine whether a piece of media was fabricated. Note that Apple has thus far declined to use the standards set by the Coalition for Content Provenance and Authenticity (C2PA) allowing us to determine the source and edits on images based on cryptographic metadata.<br>Prediction markets, which merit an article of their own, are one method of aggregating accurate information. Robin Hanson has written...