Phonely's Alma: a voice LLM trained on real phone calls
Phonely launched Alma, a voice LLM trained on 10M real calls, claiming sub-185ms to first token and $0.55 per blended million tokens against GPT-4.1's $3.50.
Phonely launched Alma today, a language model built for one job: talking on the phone. It was trained on more than 10 million real phone conversations, and the pitch is that general-purpose models are the wrong tool for a channel where people interrupt, cough, and get transcribed wrong. If you run a business where the phone still rings, the numbers are worth reading closely.
What actually happened
Alma targets the two things that decide whether a voice agent feels human: latency and unit cost. Phonely reports sub-185ms to first token, against roughly 500ms for GPT-4.1 — about 63% faster — and around 200ms at the 99th percentile. On price it lists $0.55 per blended million tokens versus $3.50 for GPT-4.1, roughly 84% cheaper (SiliconANGLE, MarTech Series).
The model was built for the mess: interruptions, background voices, garbled transcription. It drops into an existing stack — you keep your own transcriber and text-to-speech provider — and it already runs 100% of Phonely's own agent conversations, millions of calls a month. It is now available to outside teams building voice agents.
Two caveats we will not paper over. Every figure here is vendor-published; there is no independent benchmark yet. And the customer result being circulated — a 3% conversion lift worth $300,000 a month — is a single case supplied by the vendor, not a pattern you should plan around.
Why voice agent latency matters for your business
The gap between a 500ms model and a 185ms model is not a spec-sheet detail. It is the pause where a caller says "hello?" and decides they are talking to a robot. On the phone, the feel of the response arrives before the content does, and that feel is set almost entirely by time-to-first-token and by how the system behaves when someone talks over it.
The cost math is the other half. At $3.50 per million tokens, a high-volume front desk quietly becomes a line item somebody questions. At $0.55, the calls you were routing to voicemail after hours become calls you answer. That is the actual decision — not "should we have AI," but "which calls are now cheap enough to answer."
What we would not do is rebuild your call flow around one model's API. A voice stack has four swappable pieces — telephony, transcription, model, TTS — and the model is the piece most likely to be beaten on price or latency within two quarters. Keep it behind an interface. Then a launch like this is a config change and an A/B test, not a migration.
Key takeaways
- Alma is a voice-specific LLM trained on over 10 million real phone conversations, built for interruptions and bad transcription
- Phonely reports sub-185ms to first token — about 63% faster than GPT-4.1's ~500ms — and ~200ms at p99
- Listed at $0.55 per blended million tokens against $3.50 for GPT-4.1, roughly 84% cheaper
- Works with your existing transcriber and TTS provider; already handles all of Phonely's own call traffic
- All figures are vendor-published with no independent benchmark yet, and the widely quoted $300K/month customer result is a single vendor-supplied case
- Keep the model behind an interface so the next cheaper, faster voice model is a config change
The phone is still the highest-intent channel most small businesses own — and the one they answer worst. We build voice agents on a stack you control, with the model as a swappable part. Run the numbers on your missed calls, or tell us what happens after hours today.
Sources: SiliconANGLE, MarTech Series.
- #voice-agents
- #llm
- #phone-automation
- #latency
- #ai-costs
Tommy Rush — Founder, Rush Commerce
Operator turned builder. 15+ years running operations — now shipping the systems businesses run on. More
Get The Rush Report weekly — one email, zero fluff.
Keep reading
TimesFM-3 tops forecasting benchmarks. The license blocks you.
Google's TimesFM-3 leads GIFT-Eval, FEV-Bench and Time — then ships under a non-commercial license. Use TimesFM-2.5 under Apache 2.0 instead.
Read itPerplexity Hybrid Compute: the PII never leaves the Mac
Perplexity's Hybrid Compute runs an on-device PII classifier before a task hits the cloud, then routes sensitive steps to a local model on Apple silicon.
Read it