Liquid AI's reported edge decode speed on-device using llama.cpp Q4_K_M and a 4K input prompt.
MODEL INTELLIGENCE / LIQUID AI / SOURCE-VERIFIED
LFM2.5-24B-A2B explained.
24 billion total parameters. About 2.45 billion active per token. 131K context. Liquid AI's October 2026 open-weight reasoning model targets fast, private tool-using agents on consumer hardware. Compare the official benchmarks, weight sizes, running instructions, licensing and API rates—then test your device's weight budget in the original SXF Local Fit Lab.
Critical memory distinction: 2.45B active parameters do not mean that a 2.45B-size weight file is enough. Sparse experts need to be stored or offloaded. The quantized 24B weight files are roughly 13.6–25.5 GB; 16-bit files are around 48 GB, before runtime and KV cache.
Released October 13, 2026 · Sources reviewed November 1, 2026 · Benchmarks are Liquid AI's published measurements, not independent SXF testing.
DIRECT ANSWER
What is LFM2.5-24B-A2B?
LFM2.5-24B-A2B is Liquid AI's text-only, mixture-of-experts (MoE) reasoning model designed for local agents and tool use. It contains about 24B total parameters, of which 2.45B are active for each token. Released on October 13, 2026, it is the largest final member of the LFM2.5 series. The post-trained checkpoint is tuned for multi-step tool workflows; a separate base model supports customization. Liquid AI's launch announcement provides the architectural and evaluation background.
It is not a vision-language or speech model. Its documented interface is text in, text out. A tool-using agent can combine it with external code, web retrieval or document processing—but those capabilities depend on the agent harness, permissions, connectors and prompt format, not on native image or microphone input.
OFFICIAL MODEL CARD
LFM2.5-24B-A2B specifications and context window
| Model ID | LiquidAI/LFM2.5-24B-A2B |
|---|---|
| Developer / release | Liquid AI · October 13, 2026 |
| Modality / behavior | Text input and output; reasoning-first post-trained agent model |
| Total / active parameters | 24.0B total / 2.45B active per token; A2B is a rounded product label |
| Context window | 131,072 tokens (model limit, not guaranteed usable memory) |
| Layers | 40: 30 double-gated short convolution blocks and 10 grouped-query attention blocks |
| Expert routing | 64 experts per MoE block, top-4 routing |
| Vocabulary | 128,000 tokens |
| Training | Official model card: 36T-token training budget. Launch blog details 33T pre-training plus mid-training phases. |
| Official generation preset | temperature 0.1, top_k 50, repetition_penalty 1.05 |
| Distribution | Native safetensors; official FP8; official GGUF quantizations; MLX ecosystem support |
| License | LFM Open License v1.0 (lfm1.0); inspect commercial and redistribution terms |
Model-card evidence: LiquidAI/LFM2.5-24B-A2B. The context value is a maximum model specification; long-context recall and actual runtime capacity must be measured separately.
ARCHITECTURE EXPLAINED
24B total vs 2.45B active: how the MoE model works
The sparse MoE router chooses four of 64 experts at each applicable expert block for a token. This reduces work per token relative to evaluating all experts, but every expert still occupies weight storage unless the runtime offloads or streams it. Lower computation does not imply the same RAM requirements as a dense 2B model.
Text is converted with the updated 128K-token vocabulary.
30 gated short-convolution blocks and 10 GQA blocks process context.
Sparse expert paths execute for each token in MoE blocks.
The post-trained model generates reasoning and an eventual final answer; a harness controls tool execution.
Compared with LFM2-24B-A2B, the later LFM2.5 release extends context from 32,768 to 131,072, expands vocabulary from roughly 65K to 128K, and adds more pretraining and agentic post-training while retaining the 40-layer hybrid design. The October announcement describes a five-stage post-training process including SFT, distillation and agentic reinforcement learning; it also reports reward-hacking during training and tighter evaluation sandboxes.
ORIGINAL SXF INTERACTIVE EXPERIENCE
SXF Local MoE Fit Lab: which quantization fits your machine?
Choose an official GGUF file, your available RAM or VRAM budget, and a reserve for the operating system, runtime and KV cache. The result compares file size against the remaining budget—it is not a measured memory test or an FPS/tokens-per-second prediction. The tool runs entirely in the browser; no data leaves this page.
Use available memory, not disk capacity. On a dedicated GPU enter its VRAM if you want full GPU residency. Partial CPU/GPU offloading is a separate, more complex scenario.
File weights fit the selected budget on paper; real runtime, context and kernel allocations must be tested.
Open official GGUF downloads ↗SXF calculation: available weight budget = selected memory − reserve; headroom = budget − published file size. Both input units and GGUF file sizes use decimal GB. The reserve is user-supplied, not a validated KV cache estimator. For 131K contexts, real memory may greatly exceed the chosen reserve.
REAL DOWNLOAD SIZE
LFM2.5-24B-A2B GGUF sizes: Q4, Q5, Q6, Q8 and BF16
Liquid AI distributes first-party quantized builds. The numbers below are the published download weight sizes, not end-to-end RAM or GPU VRAM requirements. GGUF variants may have different fidelity; speed and quality should be tested on your real tasks.
| Quantization | Published file | What it changes |
|---|---|---|
| Q4_0 (QAD) | 13.6 GB | 4-bit, quantization-aware distillation |
| Q4_K_M | 14.5 GB | 4-bit, balanced file size |
| Q5_K_M | 17.0 GB | 5-bit, larger weights |
| Q6_K | 19.7 GB | 6-bit, larger weights |
| Q8_0 | 25.5 GB | 8-bit, large weights |
| BF16 / F16 | 48.0 GB | 16-bit, baseline-sized weights |
The official Q4_0 Quantization-Aware Distillation (QAD) variant has a distinct fine-tuned checkpoint designed to recover quantization accuracy; it is not necessarily equivalent to naive Q4_0 quantization. As a starting point, Q4_K_M weighs about 14.5 GB, while BF16 is around 48 GB. A 16GB laptop may not have adequate headroom to fully load a 14.5GB weight file plus runtime, OS and KV cache.
Why the model may not fit despite “2B active”
For MoE inference, the full collection of experts must be available in RAM/VRAM or offloaded to slower storage. The active parameter count primarily predicts a portion of compute, not how many bytes the entire model occupies. Very long contexts can add substantial cache pressure even when weight quantization is aggressive. Use actual peak RSS and GPU allocation measurements to confirm your deployment.
BENCHMARKS / REPORTED BY LIQUID AI
LFM2.5-24B-A2B benchmarks vs Qwen3.6-35B-A3B
Liquid AI published 16 benchmark comparisons. The subset below intentionally includes both wins and losses, using scores from the same vendor-published table. A higher score is better within each listed test, but task suites have different definitions, agent harnesses and sampling policies. SXF did not reproduce these evaluations.
| Test | Task | LFM2.5 | Qwen3.6 | Finding |
|---|---|---|---|---|
| AutomationBench | Agent automation | 27.69 | 8.72 | LFM higher |
| BFCLv4 | Function calling | 65.01 | 65.00 | Approximately tied |
| ToolSandbox | Tool interactions | 80.71 | 75.02 | LFM higher |
| LiveClaw | Agent workflows | 48.09 | 38.19 | LFM higher |
| PinchBench | Agent workflows | 83.18 | 89.93 | Qwen higher |
| WebArena Verified | Web agents | 26.75 | 37.62 | Qwen higher |
| IFEval | Instruction following | 96.75 | 93.06 | LFM higher |
| GPQA Diamond | Expert knowledge | 74.42 | 83.69 | Qwen higher |
| SWE-Bench Verified (OpenCode) | Software engineering | 51.00 | 66.20 | Qwen higher |
Where it looks strongest: tool use, structured instructions, certain local-agent loops. Where it trails: harder web-agent navigation, expert knowledge and software-engineering evaluations in the published comparison. Notably, PinchBench (83.18 vs 89.93) is another published agent benchmark where Qwen scores higher; agentic performance is not one uniform dimension. Verify the complete 16-test table and settings ↗.
DECODE VS AGGREGATE THROUGHPUT
Is LFM2.5-24B-A2B fast on a laptop or GPU?
Liquid AI's edge decode result in the same family of local benchmarks.
Aggregate output throughput at high concurrency with SGLang 0.5.22, BF16, 1,024 input / up to 256 output tokens.
Do not compare these as equal “chat speed” measurements. M5 Max and Ryzen numbers concern local single-workload decode. B300 figures sum output across many requests under sustained load; they do not mean one user's answer arrives at 21,000 tokens per second. Prompt processing, tool latency, CPU/GPU offload, context and model quantization all affect a real agent's wall-clock task time.
OFFICIAL CHECKPOINTS AND COMMANDS
How to run LFM2.5-24B-A2B locally with llama.cpp
Use a recent llama.cpp build supporting lfm2moe, enough memory for the selected quantization, and the official model repo. This command follows Liquid AI's published GGUF instructions and includes its recommended generation preset:
llama-cli -hf LiquidAI/LFM2.5-24B-A2B-GGUF \
--temp 0.1 --top-k 50 --repeat-penalty 1.05To select the separately trained QAD variant explicitly:
llama-cli -hf LiquidAI/LFM2.5-24B-A2B-GGUF \
--hf-file LFM2.5-24B-A2B-QAD-Q4_0.gguf \
--temp 0.1 --top-k 50 --repeat-penalty 1.05MLX, vLLM, SGLang and FP8
Liquid AI lists day-one support for MLX on Apple Silicon, vLLM / SGLang for GPU serving, and cross-platform ONNX. For multi-request serving, use the native safetensors model or the official FP8 checkpoint according to runtime support. Do not use GGUF sample commands with a native vLLM model server without converting the setup.
To make a private agent, connect a trusted local inference endpoint to an agent harness and narrowly scoped tools. Require confirmation before shell execution, deleting files, sending messages or authorizing payments; save an audit trail and measure tool-call correctness separately from text fluency. Local weights do not automatically make a tool-enabled agent safe.
Base vs post-trained: which checkpoint?
Post-trained LFM2.5-24B-A2B
Choose for ordinary inference, reasoning and tool-using local agents. Instruction and agent behavior is already post-trained.
Post-trained checkpoint ↗Base LFM2.5-24B-A2B-Base
Choose as a foundation for specialized continued training. The base model is not a drop-in instruct-chat replacement.
Base checkpoint ↗PUBLISHED COMMERCIAL RATES
LFM2.5-24B-A2B API pricing vs local inference
At its October 13, 2026 launch, Liquid AI announced these Liquid Console rates. Treat them as dated evidence; check the current billing dashboard for the up-to-date model price and availability.
Self-hosted inference does not incur Liquid Console token fees, but does cost electricity, device memory, maintenance and engineering time. Reasoning-first models can produce additional output tokens; measure actual billable outputs instead of assuming the final visible answer length captures cost. See the SXF model pricing reference for a broader cross-provider perspective.
FAIR MODEL CHOICES
LFM2.5-24B-A2B vs LFM2-24B-A2B, Qwen and LFM3
| Model | Meaningful difference | Best evaluation |
|---|---|---|
| LFM2-24B-A2B | Older related 24B MoE with 32,768 context; LFM2.5 extends context and tokenizer and adds further agentic training. | Compare identical tasks with matching quantization and memory. |
| Qwen3.6-35B-A3B | Larger MoE in Liquid AI's published table; wins certain knowledge, web and software tasks, loses others. | Read individual benchmark rows; independently test your own agent workflow. |
| LFM3 family | Later compact model family spanning text, vision, audio and decisions; different architectures and parameter scales. | Choose by input type and actual workload, not raw name/version. |
| LFM2.5-VL-DSpark | A drafting accelerator for a separate vision-language model, not another 24B agent. | Do not compare its speculative-decoding speedup with language-model accuracy scores. |
APPLICATION ENGINEERING
Best uses for LFM2.5-24B-A2B local agents
Local workflow agent
Parse instructions, select a small whitelisted tool, confirm risky actions and record outcomes. Evaluate the actual tool-call success rate, not whether the reasoning narrative sounds plausible.
On-device document assistant
Pair local weights with retrieval over permitted documents. Verify citations against source passages, especially on knowledge-heavy requests where the model trails stronger competitors.
Text extraction pipeline
Use a schema validator, retries and deterministic acceptance checks. Report exact field accuracy and failure types on held-out customer data.
International support routing
The expanded tokenizer supports a broader non-Latin vocabulary. Test Arabic, Chinese and other target languages with native examples; vocabulary size does not guarantee language parity.
SXF reproducible local-agent test protocol
- Pick 20–50 representative, permission-safe tasks and record expected outcomes.
- Freeze the model revision, quantization, prompt template, sampler, context length and tool definitions.
- Run tasks with and without external retrieval; record success, tool calls, retries, latency and failure cost.
- Repeat each test under controlled conditions, including adversarial requests and attempts to bypass tool permissions.
- Only then compare hardware cost and throughput; vendor performance numbers are not task-success guarantees.
WHAT NOT TO ASSUME
Limitations, licensing and benchmark caveats
- 24B still needs memory: only 2.45B parameters are active per token, but stored expert weights are much larger.
- Long context costs RAM: 131,072 tokens is a model specification, not a verified 131K-token laptop configuration or guarantee of perfect recall.
- Text-only: images and audio require a separate model or preprocessing components.
- Reasoning text is not proof: explicit reasoning generation can still contain errors and may consume additional output tokens.
- Different benchmark domains disagree: its published agentic strengths do not translate automatically to expert Q&A, difficult browsing and coding.
- Safety: Liquid AI reports discovering reward-hacking during training; restrict tools and revalidate behavior in your own environment.
- Open-weight license: review LFM Open License v1.0; accessible weights are not automatically unrestricted open-source software.
- API pricing changes: published launch rates and credits may not reflect later billing or regional availability.
DIRECT SEARCH ANSWERS
LFM2.5-24B-A2B frequently asked questions
What is LFM2.5-24B-A2B?
Liquid AI's text-only 24B-parameter MoE reasoning model with approximately 2.45B active parameters per token, released on October 13, 2026 for tool-using local agents.
Why is it called A2B if 2.45B parameters are active?
A2B is a rounded name. The official model card reports 2.45B active and 24.0B total parameters. The full weight set still needs memory or offloading.
What is the context length?
131,072 tokens as published by Liquid AI. Actual machine capacity and long-context retrieval quality require separate verification.
Can I run it with 16 GB RAM?
Its official Q4_0 file is about 13.6 GB, and Q4_K_M is about 14.5 GB, leaving little room for the OS and KV cache in a 16 GB configuration. Full on-device fit is not guaranteed.
Which GGUF quantization should I try first?
Choose based on available memory and quality requirements. Liquid AI publishes Q4_0/QAD, Q4_K_M, Q5_K_M, Q6_K and higher-precision versions. The SXF fit tool compares their weight sizes but does not predict total RAM usage.
Is it faster than Qwen3.6-35B-A3B?
Liquid AI claims up to 1.7 times faster on certain edge measurements; benchmark accuracy varies by task. Qwen wins some of the vendor's WebArena, knowledge and coding evaluations.
Can I run it with llama.cpp?
Yes, using a compatible recent build and the official LiquidAI GGUF repository. A verified command and sampling preset are shown above.
Does it support image input?
No. It is a text-only reasoning model, separate from Liquid AI's vision-language family.
How much is the API?
At launch, Liquid AI reported $0.10 per million input tokens, $0.05 cached input and $1.00 output. Verify current rates with Liquid Console.
Is it commercially unrestricted open-source?
It is distributed as open weights under LFM Open License v1.0. Read that license's commercial and redistribution conditions before deploying.
What changed from LFM2-24B-A2B?
The successor offers 131,072 instead of 32,768 context tokens, a 128K instead of roughly 65K vocabulary, and more reasoning/agent training.
Is there a separately trainable base model?
Yes. Liquid AI distributes LFM2.5-24B-A2B-Base for customization, separately from the post-trained agent model.
PRIMARY EVIDENCE REGISTER
Official sources and SXF verification standard
Editorial evidence reviewed November 1, 2026. Vendor-reported figures are labeled as such. The interactive weight-budget tool and local evaluation protocol are original SXF explanatory work; they do not represent an independently tested model or a measured hardware configuration.
LATEST SXF NEWS
Latest LFM2.5-24B-A2B source signal
Run fast, private agents on-device with LFM2.5-24B-A2B
Read the dated release signal ↗WHAT CHANGED
LFM2.5-24B-A2B: what changed.
No post-baseline factual changes recorded for since 2026-09-27.