Models
Grok 4.6 sells long context on a stepped price curve
Grok 4.6 launched in the API, Grok Build, and Cursor with a 500,000-token
context window. Up to 200K tokens, input costs $2 per million, cached input
$0.50, and output $6; above the threshold, prices double. xAI claims 69.9 on
CursorBench and 65.9 on DeepSWE.
The 500K is a maximum length, not a guarantee of effective recall. The
benchmarks mix xAI's results with figures published by competitors and provide
no independent cost-normalized comparison.
The price cliff makes context's architectural cost visible. An application that
indiscriminately accumulates history and tool output can cross into another
tariff with one message. Long context does not eliminate retrieval and memory
policy; it makes their financial mistakes more expensive.
Sources: Grok 4.6,
model documentation.
Open 2.4-trillion-parameter weights still require an enormous serving system
Qwen published the Qwen3.8-2.4T-A95B weights: an MoE with 2.4 trillion total,
95 billion active parameters and 92 layers. The repository dates the weight
release to August 12, though a separate cloud endpoint existed earlier.
Parameter count does not equal memory or compute per request: precision,
sharding, KV cache, and runtime all matter. Vendor benchmarks are not
independent.
Active 95B substantially reduces cost relative to a dense 2.4T model, but does
not make it local in the everyday sense. Open weights grant ownership of the
checkpoint, not a free machine to run it. At this scale, freedom from an API
provider means dependence on one's own distributed serving.
Sources: Qwen model card,
repository.
Edge vision splits between interfaces and documents
LFM2.5-VL-3B combines a roughly 3.1B language backbone with a SigLIP2 NaFlex
encoder. Liquid targets screenshots, UI localization, OCR, grounding, and tool
use. In its own ablations, ToolSandbox rose from 26.4 to 59.5, BFCL from 20.5
to 32.5, and RefCOCO from 57.1 to 87.9.
Cohere's North Micro Vision uses a 400M native-resolution encoder and a 2B
language model, preserves document aspect ratios, and supports 11 languages.
Its curriculum covered tens of millions of examples up to A4 resolution; the
model shipped under Apache 2.0.
Both sets of numbers come from their authors. Liquid supplies no hardware
latency to support the word "edge," and its license is not Apache or MIT.
Cohere still only promises vLLM support, while some competitors perform better
on STEM and hallucination. The day's signal is specialization even among small
VLMs: a UI agent and document parser need different resolution, grounding, and
runtime tradeoffs.
Sources: LFM2.5-VL-3B,
North Micro Vision.