The prompt is not an interface. Why AI sent us back to the command line… | by Joshua Leigh | May, 2026 | UX CollectiveSitemapOpen in appSign up<br>Sign in

Medium Logo

Get app<br>Write

Search

Sign up<br>Sign in

UX Collective

We believe designers are thinkers as much as they are makers. https://linktr.ee/uxc

The prompt is not an interface

Why AI sent us back to the command line — On direct manipulation, visual intent, and the regression of AI tooling.

Joshua Leigh

12 min read·<br>May 7, 2026

15

Listen

Share

Press enter or click to view image in full size

Image generated via Google Gemini

“Seeing comes before words. The child looks and recognises before it can speak.” — John Berger, Ways of Seeing, 1972 [1]

The most advanced artificial intelligence systems in history now ask us to communicate through a blinking cursor in an empty text box.<br>We have, in the most literal sense, gone backwards.<br>For the last forty years, the entire trajectory of interaction design has been a movement away from the command line and toward direct manipulation. We moved from typing instructions to pointing, clicking, dragging, and seeing the results immediately. We built interfaces that showed us what was possible rather than demanding we memorise a syntax. Then, with the touchscreen, we removed even the mouse, the most direct manipulation yet, a finger on glass, the interface collapsing to almost nothing between intention and action.<br>Then AI arrived, and we threw it all away. We retreated to the exact paradigm that a generation of researchers spent decades trying to escape: type what you want, and hope you chose the right words.<br>This is a structural failure. For tasks that are inherently visual or spatial – layout, composition, colour, form, motion – the text prompt forces a translation that loses signal at every step. It asks creative professionals to abandon the visual systems they have used for centuries and communicate their intent through a medium structurally incapable of holding it.<br>To understand why this regression happened, and why it must end, we have to look at what we were escaping from in the first place.<br>First, the command line<br>The earliest computers were not personal. They were institutional machines operated by specialists, communicating through punched cards and paper tape. You submitted a job, waited hours, and collected your output. The machine and the human occupied entirely separate time zones.<br>The interactive terminal changed this. For the first time, a human and a computer could exchange information in the same session. But the interaction model it established was narrow and unforgiving: you typed a command in the correct syntax, the machine executed it, and the result appeared as text. No image, no spatial layout, no visual feedback. The screen was a scroll of characters, offering no overview of what had come before and no map of what was possible next. This was the world of C:\> and A:\>, of DIR and FORMAT and COPY. Powerful, but only for those who had memorised its vocabulary.<br>Press enter or click to view image in full size

VT100, 1978 by Digital Equipment Corporation (DEC)For the engineers who built these systems, the command line was not a problem. They had already paid the cost of learning. For everyone else, the cost was prohibitive. It was this exclusion that a generation of researchers set out to dismantle.<br>The invention we forgot<br>In 1963, Ivan Sutherland sat before a screen at MIT and drew a line with a light pen. The computer understood the line not as a string of characters, but as a shape with geometry, constraints, and spatial relationships. The system was called Sketchpad, and its subtitle told you everything: A Man-Machine Graphical Communication System. [2]<br>Sutherland’s insight was not that computers could display images. It was that humans and machines could communicate through drawing.

Ivan Sutherland using the Sketchpad light pen on the TX-2 computer console at MIT.Douglas Engelbart’s 1968 “Mother of All Demos” demonstrated the mouse, hypertext, and windowed interfaces, all of which were premised on the same conviction: that visual, spatial interfaces augment human intellect in ways that typed commands cannot. [3]<br>Press enter or click to view image in full size

Douglas Engelbart’s 1968 “Mother of All Demos”Taken together, they describe a single coherent argument: that the machine should meet the human, not the other way around.<br>Then, on January 24, 1984, the Macintosh System 1 took these ideas into the living room. [4] No manual to memorise, no syntax to learn. The desktop was a metaphor anyone could read on sight: a folder looked like a folder, a trash can looked like a trash can. In the year that IBM’s PC still greeted its users with A:\>, the Mac showed the world that computing could be as legible as a well-designed room. Every graphical interface from Windows 95 to iOS to Android descends from that insight.<br>Press enter or click to view image in full size

The original Macintosh...