AI Coding Live News

Hume Launches Audio Decision API: Ask Plain-Language Questions of Raw Audio in One Call, 70.7% Agreement With a Human Panel per Hume

On November 2 voice AI company Hume launched the Audio Decision API, which it calls the first audio-native model that answers questions about speech and sound. Developers upload raw audio, write each question as a sentence with candidate answers, and get back a probability for each answer, with no transcription step. It supports yes/no, multiple-choice, rating-scale and time-span questions, such as how many speakers there are, whether someone laughs, whether a caller sounds frustrated, or whether a siren is in the background. Per Hume, it was trained on more than 10 million human judgments and in an initial evaluation reached 70.7% agreement with a human panel's average judgment, versus 56.5% for an individual rater. Access is currently by request or waitlist.

Hume Launches Audio Decision API: Ask Plain-Language Questions of Raw Audio in One Call, 70.7% Agreement With a Human Panel per Hume

Key Takeaways

  • Per Hume: 70.7% agreement with a human panel's average judgment in an initial evaluation, versus a 56.5% individual-rater baseline; sample size and languages were not disclosed.
  • Trained on more than 10 million human perceptual judgments (per Hume's X post); the blog cites tens of millions of listener ratings overall.
  • Four question types (yes/no, choice, scale, span); adding a question is one line of JSON, with no labeling or retraining.
  • The endpoint is POST /v0/decisions/file, plus an input-token estimate endpoint, with Python and TypeScript SDKs.
  • Hume says work that used to take 10+ models now takes one call; pricing has not been published.
Read full story
Linked Models & Agents:
⚡ Hume Audio Decision Model🌐 Hume AI

Mistral Releases Voxtral 3 Audio Model Suite and Real-Time Voice-Agent API with Sub-500ms Latency

Mistral AI unveiled Voxtral 3, a production audio intelligence suite paired with a real-time Voice-Agent API. The lineup features the 4B-parameter Mini Transcribe, Small Transcribe 3, and a turn-key voice agent SDK built on LiveKit. Supporting transcription across 50 languages with diarization, multi-lingual TTS with emotional tags across 35+ languages, and 30-minute voice cloning, Voxtral 3 redefines voice AI economics. In Artificial Analysis independent benchmarks, Small Transcribe 3 secured rank #3 globally with a 2.1% error index (outperforming ElevenLabs Scribe v2), while Realtime Transcribe delivers sub-500ms latency at $0.04/min for full voice agent turns.

Mistral Releases Voxtral 3 Audio Model Suite and Real-Time Voice-Agent API with Sub-500ms Latency

Key Takeaways

  • Mistral AI launched the Voxtral 3 suite spanning transcription, emotional TTS, studio-grade voice cloning, and a LiveKit-powered Voice-Agent SDK
  • Artificial Analysis independently verified Small Transcribe 3 at a 2.1% error index, outperforming ElevenLabs Scribe v2 (2.2%) and Grok Voice 2.0 (2.3%)
  • Realtime Transcribe 3 achieves sub-500ms latency, delivering sub-second full conversational voice-agent turns
  • Aggressive pricing: Mini Transcribe starts at $0.0035/min, and managed voice agent sessions cost just $0.04/min paired with Mistral Small 4
Read full story

Gradium open-sources Phonon on-device TTS: a 31M-parameter, 64 MB model that starts speaking in 7 ms on a laptop CPU, with the English version under Apache 2.0

On Oct 20, French voice AI company Gradium open-sourced Phonon, a family of on-device text-to-speech models: the English Phonon 31m (64 MB q8 weights, Apache 2.0) and Phonon 40m (single-language English, French, German, Spanish and Portuguese variants plus a five-language model, CC BY-NC non-commercial). Built on Kyutai's Pocket TTS and the Mimi codec, it ships its own runtime for CPU, Metal, CUDA, Vulkan, WebGPU, Core ML and Snapdragon, running offline on phones, browsers and a Raspberry Pi. Gradium reports 7 ms to first audio on a MacBook Air M5 CPU versus 517 ms for Kokoro.

Gradium open-sources Phonon on-device TTS: a 31M-parameter, 64 MB model that starts speaking in 7 ms on a laptop CPU, with the English version under Apache 2.0

Key Takeaways

  • Check the license: only the English Phonon 31m is Apache 2.0 for commercial use; every Phonon 40m variant, including multilingual, is CC BY-NC 4.0 and needs a deal with Gradium for commercial use
  • Size (official): 64 MB q8 weights for 31m and 74.6 MB for 40m; 37 built-in English voices, 102 in the multilingual model, plus voices cloned or designed with Gradium
  • Speed (vendor-measured): 6.9 ms to first audio and 29.9x real time on a MacBook Air M5 CPU with 4 threads, versus 517 ms for Kokoro (which does not stream); 38 ms and 3.7x real time on a Raspberry Pi 5; 7.5 ms on Snapdragon 8 Elite Gen 5
  • Accuracy (vendor-built hard-sentence set, 500 per language, public on HF): English WER of 1.70% for 31m and 2.22% for 40m versus 3.50% for Kokoro and 8.71% for NeuTTS Nano, with text normalization for numbers, dates and version strings
  • Get started with uvx ptts or pip install ptts, the phonon-tts npm package for browsers, or the gradium-ai/xn-ptts runtime on GitHub
Read full story
Linked Models & Agents:
⚡ Phonon 31m⚡ Phonon 40m⚡ Phonon 40m multilingual⚡ Pocket TTS⚡ Kokoro🤖 Pipecat🌐 Gradium🌐 Kyutai🌐 Arm🌐 Qualcomm🌐 Hugging Face