AI Coding Live News

On November 2 voice AI company Hume launched the Audio Decision API, which it calls the first audio-native model that answers questions about speech and sound. Developers upload raw audio, write each question as a sentence with candidate answers, and get back a probability for each answer, with no transcription step. It supports yes/no, multiple-choice, rating-scale and time-span questions, such as how many speakers there are, whether someone laughs, whether a caller sounds frustrated, or whether a siren is in the background. Per Hume, it was trained on more than 10 million human judgments and in an initial evaluation reached 70.7% agreement with a human panel's average judgment, versus 56.5% for an individual rater. Access is currently by request or waitlist.

Zoom

Anomaly, the company behind open-source coding agent OpenCode, shipped Hex 3.0 stable: hold a shortcut, speak, and the text is pasted at your cursor. Recognition runs on-device, local model memory drops from about 900 MB to about 160 MB, and it adds vocabulary hints, a hex CLI and optional OpenCode rewriting.

Zoom

Voice model company Cartesia launched Managed Agents on Oct 29, an end-to-end voice agent platform for enterprise phone calls that tunes its own speech-to-text and text-to-speech models together with the agent harness, and bundles telephony, knowledge bases, tool calls and outbound batches. Cartesia says it ranks #1 on Artificial Analysis's Speech Agent Arena with a 1115 Elo and scores 87.4% accuracy and 90.7% experience on ServiceNow's EVA-Bench (vendor-reported, with GPT-5.5 as the reasoning model). Launch pricing is 50% off at $0.03 per minute.

Zoom

On Oct 28 OpenAI announced through @ChatGPT that users can now text their dot, the always-on agent inside ChatGPT. You can hand it a task or something to watch using text, photos or voice notes, and it texts you proactively when there is a relevant update. Texting runs over iMessage or RCS, not plain SMS; only you can text your dot and it can only text you. It is rolling out in beta to a limited number of US Pro users and is not supported in Business or Enterprise workspaces. Texts pass through the third-party provider Linq, and OpenAI says the conversation is not end-to-end encrypted.

Zoom

On Oct 26 Apple released iOS, iPadOS, macOS, watchOS and visionOS 27.2, and Siri AI (beta), the assistant rebuilt on Apple Intelligence, now supports French, Japanese, Korean, Portuguese and Spanish in addition to English. Apple says Traditional Chinese, Norwegian, Turkish and Vietnamese will follow by the end of the year. Per the iOS 27.2 release notes, Siri AI can now recall past conversations and draw on more sources such as photos in Messages, Calendar attendees and voicemails. Siri AI is still unavailable in the EU on iOS, iPadOS and watchOS and in mainland China, and server-side features have daily usage limits; Apple says expanded access will be offered for a fee in the future.

Zoom

On Oct 26 Tencent Hunyuan (Tencent Hy) open-sourced Hy-SimulMT, a real-time simultaneous interpreting model for bidirectional Chinese-English speech-to-speech translation. It translates while the speaker talks, outputs both translated text and speech, and can clone the speaker's voice in real time. Six checkpoints landed on Hugging Face (30B-A3B translation-only and source-plus-translation Interleave variants, each in BF16, FP8 and GGUF), with the model card listing Apache-2.0; GitHub ships the SimulInfer serving stack and SimulTrain training tools. Vendor-reported: about 3s StreamLAAL on RealSI long-form audio, the lowest among compared systems.

Zoom

Mistral AI unveiled Voxtral 3, a production audio intelligence suite paired with a real-time Voice-Agent API. The lineup features the 4B-parameter Mini Transcribe, Small Transcribe 3, and a turn-key voice agent SDK built on LiveKit. Supporting transcription across 50 languages with diarization, multi-lingual TTS with emotional tags across 35+ languages, and 30-minute voice cloning, Voxtral 3 redefines voice AI economics. In Artificial Analysis independent benchmarks, Small Transcribe 3 secured rank #3 globally with a 2.1% error index (outperforming ElevenLabs Scribe v2), while Realtime Transcribe delivers sub-500ms latency at $0.04/min for full voice agent turns.

Zoom

On Oct 20, the FastVideo team at UCSD's Hao AI Lab open-sourced FastH3 Omni, a distilled version of MiniMax H3's reference-to-video-and-audio (Ref2VA) model that generates video with synchronized stereo audio from text plus up to nine images, video clips and voice references. Sampling drops from 50 steps to eight transformer evaluations, cutting end-to-end latency 5.6-11.9x on eight GB200s by the team's measurements. Training code is open, with NVFP4 weights for DGX Spark and RTX 5090 and ComfyUI support.

Zoom

On Oct 20, French voice AI company Gradium open-sourced Phonon, a family of on-device text-to-speech models: the English Phonon 31m (64 MB q8 weights, Apache 2.0) and Phonon 40m (single-language English, French, German, Spanish and Portuguese variants plus a five-language model, CC BY-NC non-commercial). Built on Kyutai's Pocket TTS and the Mimi codec, it ships its own runtime for CPU, Metal, CUDA, Vulkan, WebGPU, Core ML and Snapdragon, running offline on phones, browsers and a Raspberry Pi. Gradium reports 7 ms to first audio on a MacBook Air M5 CPU versus 517 ms for Kokoro.

Zoom

On Oct 20 ElevenLabs released Eleven Realtime, end-to-end speech-to-speech models where each model is a complete voice agent, removing the need to wire up speech recognition, an LLM and text-to-speech yourself. v1 Mini targets low-cost natural conversation and v1 Max targets support and multi-step tool use. Both cover 90+ languages and 17,000+ voices. Citing independent Artificial Analysis evals, Max answers 98.8% of Big Bench Audio correctly and starts speaking in 0.57s on average. The API is OpenAI Realtime compatible, so migrating means changing the endpoint and model name.

Zoom

On Oct 20 Mistral released Voxtral 3: the Voxtral Small/Mini Transcribe 3 speech-to-text models, Voxtral Mini Transcribe Realtime 3, the Voxtral Mini TTS 3 (Voxtral Speech 3) text-to-speech model, and a LiveKit-based voice agent SDK that streams listening, reasoning with tool calls, and speaking as one pipeline, with each turn completing in under a second per Mistral. Transcription covers 50+ languages with diarization and context biasing; TTS covers 35+ languages and 50+ dialects, plus Pro Voice cloning from 30 minutes of audio. It is live on the Mistral API (EU, US and global endpoints) and can be self-deployed.

Zoom

In the latest independent Text-to-Speech (TTS) evaluations published by Artificial Analysis, Ant Group's open-source Ming-3.0-tts achieved a 93.2% pronunciation accuracy score, ranking #1 among all 31 evaluated models (outperforming commercial leader ElevenLabs v4 at 91.7%). Offering both a dense 0.5B parameter variant and a 7.9B mixture-of-experts (MoE) model, it delivers voice cloning and preset voices with a Controlled Voice Elo score of 1,069 (#1 among open-weight models), fully released under the permissive MIT license.

Zoom

On October 19 Ant Ling (inclusionAI) open-sourced five Ming-3.0 models under MIT, spanning speech synthesis (tts-0.5B; tts-tiny, 7.9B total/1.3B active), audio understanding (audio-flash, 126B/6.5B active; audio-tiny, 9.3B/2.7B active) and speech recognition (asr-tiny, 8.6B/2B active). Per the vendor, tts-0.5B ranks #1 among open-weight models on Artificial Analysis Controlled Voice at 1069 Elo and ties #1 overall on pronunciation robustness at 93.2%; asr-tiny averages 4.41% error across four ASR categories. Weights are on Hugging Face and ModelScope, with day-0 SGLang and vLLM support.

Zoom

On Oct 16 OpenAI made prompt-to-voice generally available to all API customers. Developers describe accent, pitch, timbre and pace in plain text and create a saved custom voice through /v1/audio/voices or the voice Playground, then reuse it in GPT-Live sessions. Creating a voice is free; speech uses regular GPT-Live session billing, with up to 100 prompt-generated voices per organization. OpenAI also added nine natural GPT-Live voices in German, French, Hindi, Japanese and Korean.

Zoom