Ruby on Rails on X: "Agents on Rails: We ran 8 models against 21 atomic tasks to see which were best at writing Rails code. 3 runs each: a bug report, a security finding, a feature request.
The first benchmark report with findings is now live. So: what did we discover?
As of August 2026:<br>- Most https://t.co/xs8zItKWca" / X<br>Post
Log inSign up
Post
Ruby on Rails on X: "Agents on Rails: We ran 8 models against 21 atomic tasks to see which were best at writing Rails code. 3 runs each: a bug report, a security finding, a feature request.
The first benchmark report with findings is now live. So: what did we discover?
As of August 2026:<br>- Most https://t.co/xs8zItKWca"
Ruby on Rails
@rails
Agents on Rails: We ran 8 models against 21 atomic tasks to see which were best at writing Rails code. 3 runs each: a bug report, a security finding, a feature request.
The first benchmark report with findings is now live. So: what did we discover?
As of August 2026:<br>- Most accurate: @claudeai Opus 5 by @AnthropicAI (by a hair). Solved 92% of runs (58 of 63). (But for a little more than half the cost, you get almost the same accuracy with @Kimi_Moonshot.)<br>- Cheapest: @OpenAI GPT-5.6 Luna. 73% of runs solved at default medium reasoning effort, and all 63 of its runs cost 90 cents combined.<br>- Fastest: Luna again, at a median of 3.3 minutes per run task.<br>- Best combination of all three: @OpenAI GPT-5.6 Sol. 84% accuracy, costing $0.52 and 5 minutes per run.
Read all the findings in the first full benchmark report from @evilmartians here: rubyonrails.org/2026/8/13/agen…
span:not(:empty)~span:not(:empty)]:before:content-['·'] [&>span:not(:empty)~span:not(:empty)]:before:px-1 [&>span:not(:empty)~span:not(:empty)]:before:shrink-0">5:15 PM · Aug 13, 202612.3KViews
61<br>15
span:not(:empty)~span:not(:empty)]:before:content-['·'] [&>span:not(:empty)~span:not(:empty)]:before:px-1 [&>span:not(:empty)~span:not(:empty)]:before:shrink-0 min-w-0 overflow-hidden">Juraj Kostolanský
@jkostolansky
31m
What about Grok?
249
span:not(:empty)~span:not(:empty)]:before:content-['·'] [&>span:not(:empty)~span:not(:empty)]:before:px-1 [&>span:not(:empty)~span:not(:empty)]:before:shrink-0 min-w-0 overflow-hidden">Max Kearney<br>@MaxKearney114
21m
I’m curious to know how Grok would place
188
Log in or sign up for X<br>See what’s happening and join the conversation<br>Continue with phoneContinue with AppleContinue with Google<br>or<br>Log in with username or email
Relevant people
Ruby on Rails@railsFollow<br>Ruby on Rails scales from PROMPT to IPO. Token-efficient code that's easy for agents to write and beautiful for humans to review.
Trending now