Skip to content
Rush Commerce
AI & Automation3 min read

Ramp Router: your expense vendor now sells you inference

Ramp launched Router.com, a single API that routes every LLM call to the cheapest model that clears your bar. Free through 2026. Read the retention default first.

Ramp launched Router.com today: one API endpoint that sends each AI request to the lowest-cost model meeting your performance bar. Four days after Stripe agreed to buy OpenRouter, the expense-management company that watches your AI spend decided to sell you the AI. That is the story. Model routing stopped being infrastructure and became a customer-acquisition channel.

What actually happened

Ramp's launch post describes four routing strategies:

  • Flex tier — drops to a provider's discounted service tier when latency is close enough to standard.
  • Shadow models — runs a candidate model against real production traffic without touching what users see.
  • Benchmark routing — weights up to three metrics and routes on the blend.
  • NVIDIA Switchyard — keeps routine turns on a cheap model and escalates only the hard ones. Ramp's internal example: a coding agent ran 58 turns on the cheaper model and escalated the last five.

One API reaches OpenAI, Anthropic, and open models including DeepSeek, Kimi, GLM, and Qwen; the announcement says Gemini is coming. Ramp claims early customers cut inference costs about 40% on average. That is a vendor number about vendor customers, not an audited benchmark — treat it as the top of the range.

Routing is free through 2026 with $26 in model credits; you pay provider rates for tokens. 2027 pricing is unannounced. US only. Per TechCrunch, the default retains inputs and outputs for one year with PII stripped before product use.

Why model routing belongs in your stack, not your vendor's

The economics are real. Most teams pin one expensive model for every call because switching means a rewrite, and the cheap-model-plus-escalation pattern genuinely works. We build it into client systems.

The part to think about is where the seam lives. A router is the exact place where your prompts, your outputs, and your unit economics all pass through one throat. Handing that to a company whose other product already reads your spend is a real decision, not a checkbox.

Three questions before you point production at anyone's endpoint:

Is the interface portable? If your code calls an OpenAI-shaped API, you can swap the base URL when 2027 pricing lands. If you adopt proprietary routing verbs, you cannot. What happens to prompts? One year of retained inputs and outputs is a data-governance fact your contracts may already speak to. Change the default or accept it in writing. Who owns the eval? Routing decisions are only as good as the benchmark behind them. If the vendor grades the models and also bills the tokens, keep your own scorecard.

Key takeaways

  • Ramp launched Router.com on August 20, 2026 — one API across OpenAI, Anthropic, and open models, Gemini pending
  • Four strategies: flex tier, shadow models, benchmark routing, and NVIDIA Switchyard escalation
  • Ramp reports ~40% average inference cost cuts for early customers; free routing through 2026, US only, 2027 pricing unannounced
  • Default retention is one year for inputs and outputs, PII stripped before product use
  • Keep the routing interface OpenAI-shaped and keep your own eval, so switching stays a config change

Do you know what your cheapest acceptable model is for each job? We build routing layers that live in your codebase, with your evals and your escalation rules — so a vendor's 2027 price change is a one-line edit. See how we architect AI systems, or estimate what routing would save you.

Sources: Ramp — Introducing Ramp Router, Ramp press release, TechCrunch.

  • #llm-routing
  • #ai-costs
  • #api-design
  • #vendor-lock-in
  • #inference
TR

Tommy Rush — Founder, Rush Commerce

Operator turned builder. 15+ years running operations — now shipping the systems businesses run on. More

Get The Rush Report weekly — one email, zero fluff.