Do It By Hand First: A Method for Keeping Critical Thinking Alive in the Age of AI — A Parent's Guide to AI

Skip to main content

The first time I hit a genuinely hard problem at work, I solve the whole thing by hand.

I'll use every tool I have to research it: documentation, search, and yes, AI. But I make myself take each step. I want to feel where it's hard and where I was wrong. When it's finally working, I stop and write down how I actually got there, while it's fresh.

The second time the same problem shows up, I don't do it all by hand again. I take those notes and turn the boring, repeatable parts into a script (usually a small computer program), so I can spend my attention on the one or two decisions that actually need judgment.

The third time, or when I know I'll face it forever, I build something that handles it automatically. By then I understand the problem well enough to trust a machine with it. Just as importantly, I understand it well enough to notice the day the machine gets it wrong.

For years I thought this was a method for going faster. It isn't, really. It's a method for making sure that when I finally hand a task to a machine, I've already earned the understanding to catch it when it fails. And that turns out to be the exact thing AI makes it very, very easy to skip. For our kids, and for us.

This post is part method, part evidence, and part opinion, and I'll tell you which is which as we go. It is not an argument against AI; I use these tools every day, and this whole site exists to help you use them too. It's also not a research paper. It's one practical way to think about the single skill I most want my kids to keep: the ability to actually think, even when a machine offers to do it for them.

A method I borrowed from engineering

Strip the jargon off what I described above and it's a simple ladder with four rungs:

Do it by hand. The first time, take every step yourself. Use tools to research, but do the actual work.

Write it down. Once it works, capture how you got there, the wrong turns included.

Script the parts that repeat. The second time, automate the routine steps so you can focus your attention on the parts that need real judgment.

Automate it fully, but only once you've earned it. Hand the whole thing to a machine only after you understand it well enough to check its work.

The important part isn't any single rung. It's the order, and the fact that automation comes last . You don't start by handing the problem to the machine. You end there, and you only trust the handoff because you built the understanding first.

That order is the whole argument of this post. The tempting thing about AI, for a busy adult and for a twelve-year-old with homework due, is that it lets you jump straight to rung four on a problem you've never once done by hand.

Why the order matters more than the speed

Here's the part that's actually well-studied, and it surprised me when I first read it: the struggle isn't a cost you pay to get to the understanding. The struggle is how the understanding forms.

Three findings from decades of learning research point the same way.

You remember what you produce better than what you're handed. Psychologists call it the generation effect: people who generate an answer themselves, even a partial or wrong one, remember it far better than people who simply read the correct answer.1 The act of producing it is what makes it stick.

Retrieving something is a stronger teacher than reviewing it. Testing yourself on material, pulling it out of your own head, produces much more durable learning than reading it again, even though re-reading feels more productive.2 The effort of retrieval is the point.

Learning that feels harder now tends to last longer. Researchers call these desirable difficulties: conditions that slow you down and make you work often produce deeper, more durable understanding than conditions that make things feel smooth and easy.3 Easy and fast frequently means shallow and gone by next week.

I want to be careful here, because this is exactly where it's easy to overclaim. So let me under-claim instead. None of these studies measured "critical thinking" directly; they measured memory and learning. And I know of no study that has tested whether my particular four-rung method builds it. What the research does support is narrower and sturdier: understanding you build yourself sticks better than understanding you're handed.

Critical thinking leans on that, though it isn't the whole story. You can question a claim in a field you barely know, asking who's behind it, what they gain, and whether other sources agree. That's the bias-spotting habit worth teaching all on its own. But the deepest kind of check, knowing an answer is wrong because you understand the thing, only comes from having done the work. Skip the doing, and you're left with just the surface checks.

That's rung one and rung two of the ladder, and it's why they come first: do it by...