Introducing efficiency focused “ThinkingCap” model series
Home<br>Home
Founders
Founders<br>About
Blog
Contact
About<br>Blog<br>Contact<br>hey(at)bottlecapai.com
Introducing efficiency focused “ThinkingCap” model series.
TL;DR
One of our core aims at BottleCap is efficiency in AI. To fulfil this mission, we fine-tuned Qwen3.6-27B to reduce unnecessary reasoning while preserving answer quality.
The result:
46% fewer reasoning tokens on average
Comparable benchmark performance
Fewer reasoning loops and failure cases
Lower latency and inference cost
Shorter, more to the point answers
Across twelve out-of-domain benchmarks, the model produced nearly identical accuracy while using roughly half as many thinking tokens.
We are releasing the model publicly on HuggingFace under a permissive Apache 2.0 licence. Anyone can freely download the model and instantly replace their local Qwen model to save money & time.
Contact us if you want further optimizations to save even more: enterprise@bottlecapai.com
Your browser does not support the video tag.
Why do reasoning models overthink?
Reasoning models have changed our expectations around language model performance. Given enough time and enough tokens, they can solve problems that were previously inaccessible to older generations of models.
The downside is that they often think far longer than necessary. Even relatively simple questions can trigger thousands of reasoning tokens:
revisiting already established assumptions,<br>repeatedly reformulating the same argument,<br>getting stuck in loops,<br>spending more time explaining than solving,<br>unnecessary filler words and verbose style for thinking that users do not even read.
This behaviour improves benchmark performance in some settings, but it also introduces costs: higher latency, higher inference spend, lower throughput, increased energy consumption, more compute, and more opportunities for failure.
Long reasoning traces have gradually become associated with intelligence, when in reality they often represent inefficiency. We wanted to cut through all of that, on the machine level. The question we asked was simple: how much of the modern model’s reasoning is actually necessary?
The objective
Our goal was intentionally conservative: do not try to make the model smarter or teach it new capabilities. We wanted to preserve knowledge, reasoning ability, answer quality, conversational style, instruction following, and safety behaviour.
The only thing we wanted to change was the amount of computation spent reaching an answer. In other words: keeping the same model, and making sure it overthinks less.
Training approach
Starting from the Qwen3.6-27B (Qwen Team, 2026) base model, we trained on a curated set of problems covering multiple domains and difficulty levels. The training objective rewarded efficient reasoning rather than simply rewarding correctness.
Importantly, the intervention was designed to remain as non-invasive as possible. The resulting model behaves very similarly to the original checkpoint — same style, same capabilities, same knowledge — but with substantially shorter reasoning traces. The model learns to stop once it has enough information to answer confidently.
Evaluation methodology
Evaluating reasoning models is more difficult than evaluating standard language models. At the recommended sampling temperature of 1.0, output quality and length can vary substantially between runs, so single-seed numbers give an incomplete picture. To reduce noise, we evaluated using full benchmark datasets, five independent random seeds, and statistical significance testing across all comparisons.
We evaluated both in-domain tasks (held-out portions of datasets related to training) and out-of-domain tasks (designed to test generalisation). The suite covers scientific reasoning and math, knowledge-based question answering, long-context tasks, system-prompt adherence, coding and agentic tasks, multi-turn conversational behaviour, and safety and model guardrails.
Results
Out-of-domain token efficiency
The chart above shows the mean number of thinking tokens per response on each out-of-domain benchmark. ThinkingCap-Qwen3.6-27B spends far fewer thinking tokens than the base model across the board — on most benchmarks less than half, and on the heaviest reasoning sets (such as GPQA-Diamond) the mean drops by well over 60%.
A natural worry is that simply pushing a model to emit fewer thinking tokens trades away capability — shorter reasoning, worse answers. That is the usual failure mode of token-efficiency work, but it is not what happens here: we deliberately set out to preserve the model’s performance, not just to cut its length.
And the accuracy chart above bears that out — across the same out-of-domain benchmarks, ThinkingCap-Qwen3.6-27B tracks the base model’s accuracy almost exactly, despite the large reduction in thinking tokens.
Benchmarkacc (base)acc (Ours)Δ acctok...