Latent Space as a New Medium - by Kevin Kelly - KK
KK
SubscribeSign in
Latent Space as a New Medium
Kevin Kelly<br>Jul 13, 2026
Share
Subscribe
Winslow Homer’s most famous watercolor rendered as a child’s drawing.<br>Lately I’ve been asking myself: what might artificial intelligence be good for besides answering questions and writing code? My answer is the latent spaces within AIs themselves will become a new medium for creativity. I will first explain what I mean by latent space, and then at the end of this explanation, I offer possible ways scientists and artists may use the latent spaces inherent in neural nets to serve as a new platform for creativity.
A Large Language Model (LLM) is like a small zip file that contains all human knowledge. It takes massive arrays of 100,000 GPU chips working in the cloud, and costing billions of dollars, to compress all of human writing into a small working model that could run on one single GPU chip. Even the biggest frontier models compress down to several hundred gigs, which is small enough it can fit on a card in your palm. In a strange but real way the resulting tiny file contains all the information that is on the internet and in our libraries. This tiny card holds a significant proportion of what humans collectively know. Of all the remarkable aspects of AI, this astounding feat of compression may be the least appreciated. This dense, high order compression of human knowledge — called “latent space” — may also be a new medium itself.<br>This extreme compression of knowledge within latent spaces was not the original intention of the researchers who invented LLMs. The book smartness they contain came as sort of a surprise to the people training them, and we are still trying to figure out how they actually work. What we can say for sure is that the LLM does not contain copies of everything it knows. For instance it knows all Shakespeare plays, and it could create a new play that sounded exactly like Shakespeare, and can even quote famous lines in his plays, but nowhere in the model are the actual texts of Shakespeare. Instead there is simply the abstract information about all the plays, the plots, the characters, the words, the style, the references. Likewise, the LLM could recognize the face of almost any person, and it could generate any possible human face, but nowhere in its code are copies of human faces. Rather, the model is storing all the information about human faces, without storing any faces.<br>This is weird. Until recently we might have thought that all the information about a thing would take up more storage space than the thing itself. That may be true for a single thing, but not for the aggregate of all things. That is because most things share a lot of common attributes with other things. The neural nets of an LLM do a magic trick by abstracting the information of everything at once, so that it uses the myriad common relationships between things and ideas to compress and abstract them into this virtual “latent” or hidden space.<br>All three terms in “Large Language Model” are key. For “Large”, the models contain all the knowledge in, say, Wikipedia, and all the text from decades of the internet, all webpages and online discussions, and all the scanned books and journals in most libraries. So far, the power of the model keeps increasing as it gets scaled up in size. The more information it is trained on, the more connections, the better it gets.<br>The “Language” part of LLMs turns out to be the secret sauce. LLMs were originally invented to do automatic language translation, that is all. But instead of teaching it the rules of language, which is what earlier AI researchers did, this time no language expertise was required. Instead, a neural net absorbed a very large database of human written language (the internet), with the goal of having the neural net (AI) extract out all the hidden patterns of language below our awareness contained within those billions of documents. The goal of the program was to replicate, imitate and synthesize the patterns of language as it is used everyday by humans.<br>The results shocked everyone. Sure the LLMs could translate language like a human, but the AI also displayed glimpses of human-like intelligence. They could also be creative with language, like they could write up a sales pitch in the style of a sonnet. Some early researchers were spooked by this emergent behavior, including a Google researcher who felt Google’s LLM had an internal intelligence that should not be turned off. We now understand that the intelligence we see in LLMs comes from the logic within the language they were trained on. (See my Why Are LLMs Smart?)<br>The form of this new mindfulness — the “Model” part of LLMs — is a latent space. Latent space is an abstraction, a map built not in two dimensions, but in billions of dimensions. Imagine a brain made up of billions of straight long arrows going in all directions. Each arrow is dedicated to one idea or...