LFM2.5-2.6B: Deploy Agents Everywhere — Blog — Liquid AI

Connect

h2]:clear-both [&>h3]:clear-both">Today, we release LFM2.5-2.6B , an agentic model that runs entirely on-device. It is small enough to run on a phone, fast enough to stay responsive on a CPU, and capable enough to power agentic workflows: planning, calling tools, and tackling multi-step tasks.<br>Unlike agents that depend on cloud APIs, local agents give you free inference, low latency, and real privacy. Removing the per-token cost changes how developers build: agents can now be massively parallelized on local hardware, running background tasks that burn through millions of tokens at no marginal cost. When token spend is no longer a constraint, agents can be run everywhere around the clock.<br>The base (LFM2.5-2.6B-Base) and post-trained (LFM2.5-2.6B) models are available today on Hugging Face. Check out our docs on how to run and fine-tune them locally.<br>Training<br>LFM2.5-2.6B is a 2.6B parameter model specifically trained for agentic workloads. It's pre-trained on ~34T tokens. To better support non-Latin scripts in LFM2.5, we doubled the vocabulary to 128K by extending the existing tokenizer in place rather than retraining the model from scratch, using the same procedure as in LFM2.5-8B-A1B. Mid-training includes a dedicated 128K context-extension phase so the model can handle the long inputs that agentic workloads require.<br>The schematic summarizes the four-stage post-training pipeline that turns LFM2.5-2.6B-Base into the agentic LFM2.5-2.6B: Supervised Fine-Tuning (SFT), Teacher Specialization , Multi-Domain On-Policy Distillation (MOPD), and Agentic Reinforcement Learning (Agentic RL).<br>Supervised fine-tuning. Post-training begins with two consecutive SFT stages: starting with broad coverage across all domains, followed by targeted shaping on priority skills like agentic tasks, reasoning, and tool use. Across the two stages, the SFT training mix is about seven times the size of the one used for LFM2.5-8B-A1B, with heavier weighting toward agentic tasks such as tool use, web search, software engineering, and agent traces. The final SFT checkpoint serves as both the student model and the initialization checkpoint for training a set of specialist teachers for a later distillation stage.<br>Teacher Specialization. From the shared SFT checkpoint, we train one expert per target domain through a focused SFT round on a reweighted mix, followed by reinforcement learning with verifiable rewards (RLVR). The resulting specialists cover instruction following, math, knowledge including hallucination control, code, tool use, and long context. Training them separately lets each expert optimize deeply for its own domain, using targeted data and rewards without competing updates from unrelated objectives.<br>MOPD. We then use the specialized experts as teachers and distill their capabilities into a single student model. Unlike off-policy distillation, where the student learns from trajectories generated by another model, MOPD lets the student roll out under its own policy. Each prompt is routed to the teacher for its corresponding domain, which supervises the student's response with token-level feedback.<br>Because the teachers branch from the same SFT checkpoint as the student, their feedback stays close enough to the student's distribution to guide learning without destabilizing training. This dense, routed supervision helps the student converge quickly while integrating domain-specialized capabilities into a single model.<br>Agentic RL. The final stage teaches the model to operate inside real agent environments. We run multi-turn agentic RL through real agent harnesses, where the model works through realistic productivity tasks that evaluate its ability to research, write, code, analyze data, manage documents, use external tools, and automate multi-step workflows.<br>During training, we sample a task and randomly select a corresponding harness. Each rollout runs in a dedicated sandbox with its own runtime. We optimize with GRPO, using an outcome-based reward that combines an LLM-as-a-judge rubric, programmatic checks, and a hard safety gate. Training directly inside Hermes Agent, OpenClaw, and other harnesses exposes the model to their tools, system prompts, and interaction patterns, helping it work reliably across agent environments.<br>The training pipeline separates model optimization, inference, and environment execution into distinct components. The Training Engine (FSDP) optimizes the model, while the Rollout Engine (SGLang) generates actions using the latest policy. The RL framework (verl) orchestrates the training loop by launching rollouts, collecting trajectories and rewards, and updating the model.<br>Actions are executed within a Sandbox Service , where the Blackbox Harness hosts the agent (e.g., OpenClaw or Hermes Agent) and coordinates interactions with the task environment through tool calls, code execution, and other task-specific operations. The Harness Proxy lets...