Mercury 3 hits 1,068 tokens/sec. Don't price on the discount.
Inception's Mercury 3 diffusion LLM runs 1,068 tokens/sec with a 1M context at $0.20/$0.70. The 50% launch discount has no end date — budget at list.
Inception Labs shipped Mercury 3 today, the newest version of its diffusion LLM. It writes 1,068 tokens per second on Nvidia GPUs, the context window grows to 1 million tokens, and list price is $0.20 input / $0.70 output per million tokens. There is a 50% launch discount. The page does not say when it ends. That one missing date should shape how you build on it.
What actually happened
- Speed: 1,068 tokens/sec on Nvidia GPUs. Inception claims 4–8x faster than comparable models.
- Context: 1M tokens, up from 260K on Mercury 2.5.
- Price: $0.20 / $0.70 per million tokens at list. With the launch discount: $0.10 / $0.35. Cached input gets 90% off.
- Quality: Inception says Mercury 3 matches or beats GPT-6 Luna and Claude Haiku 5.5 "across a range of benchmarks." It publishes no scores for that claim.
- Access: OpenAI-compatible API on Inception's platform, plus OpenRouter, Baseten and Vercel. New accounts get 100 million free tokens.
Diffusion models do not write one token at a time. They draft a whole block and refine it in parallel, which is where the speed comes from.
Why a 1,000-token-per-second LLM matters for your business
Speed changes what you can build, not just how fast it feels. At 1,000+ tokens per second, a full product description, support reply or SQL query comes back in well under a second. That makes some features possible that were too slow before: autocomplete in a form, a rewrite on every keystroke, an agent that runs ten small steps before the user notices.
But two habits keep this from going wrong:
- Budget at list, not launch price. A discount with no end date is a marketing line, not a contract. If your margin only works at $0.35 output, your margin does not work.
- Test quality on your own tasks. "Matches Haiku on a range of benchmarks" with no numbers is a claim. Run 50 of your real prompts through both and grade them blind.
Because Mercury 3 speaks the OpenAI API format, the test costs almost nothing: change a base URL and a model name. That is the right way to try any new model — behind a config flag, with an eval, and with an easy way back.
Key takeaways
- Mercury 3 is a diffusion LLM at 1,068 tokens/sec on Nvidia GPUs, with a 1M-token context
- List price $0.20 input / $0.70 output per million; 50% launch discount with no stated end date
- Quality claims versus GPT-6 Luna and Claude Haiku 5.5 have no published scores
- OpenAI-compatible, on OpenRouter, Baseten and Vercel — easy to test behind a flag
- Model your margin at list price and eval on your own prompts
Fast enough to build something new? We prototype sub-second AI features — live autocomplete, instant rewrites, quick agent steps — and price them at list, not at launch promo. See what we've shipped, or tell us the feature you thought was too slow.
Sources: Inception Labs.
- #inception-labs
- #diffusion-llm
- #llm-pricing
- #latency
- #ai-inference
Tommy Rush — Founder, Rush Commerce
Operator turned builder. 15+ years running operations — now shipping the systems businesses run on. More
Get The Rush Report weekly — one email, zero fluff.
Keep reading
doubleAI Maxwell rewrites running code. Profile before you pay.
doubleAI's Maxwell rewrites machine code under running Python and charges a share of compute savings. Profile your workload before you sign.
Read itDeepSeek Search API: $0.75 per 1,000. Check where queries go
DeepSeek's Search and Fetch APIs cost $0.75 per 1,000 successful requests, with billing from November 1. Cheap web search for agents, but check the data path.
Read it