SignalStack
Volver a noticias

Mistral AI presenta Voxtral 3: Transcripción de voz a texto, síntesis de voz y un SDK de agentes de voz

Leer original

Resumen con IA

Voxtral 3 de Mistral unifica las capacidades de transcripción de voz a texto, síntesis de voz y agentes de voz en una única API, simplificando el desarrollo de aplicaciones de voz en tiempo real.

Resumen generado con IA. Consulta el original para comprobar el contexto y la precisión.

Extracto de la fuente

Este es el extracto disponible del feed. Puede estar abreviado o en el idioma original.

Mistral AI just released Voxtral 3. Mistral Voxtral 3 is a speech model family paired with a voice agent SDK. It ships 3 transcription models, 1 text-to-speech model and an SDK built on LiveKit. One place for listening, reasoning, tool calls and speaking. All 4 models are in public preview on the Mistral API. TL;DR Size: Voxtral Mini Transcribe 3 has 4B parameters. Small Transcribe 3 size: not disclosed. Both batch models list a 32k context. Runs on: Mistral API (EU, US and global endpoints) or your own infrastructure via Mistral sales. GPU and VRAM needs: not disclosed. Mistral says Mini suits resource-constrained environments. Performance: Top 3 on independent speech-to-text rankings, strongest on diarization and multilingual batch transcription. Best: 2.1% AA-WER for Small Transcribe 3, #3 on Artificial Analysis. Worst: Realtime at 240 ms: 7.4% WER on FLEURS 35, vs 4.2% for Gemini 3.5 Realtime. What is in the Voxtral 3 family? Mistral lists 4 models and 1 SDK: Voxtral Small Transcribe 3: flagship batch transcription and diarization. Docs also list translation, speech Q&A, summarization and function calling. Voxtral Mini Transcribe 3: a 4B model for cheaper, faster batch jobs. Voxtral Mini Transcribe Realtime 3: streaming ASR over WebSocket with end-of-turn detection. Voxtral Speech 3: text-to-speech, also called Voxtral Mini TTS 3 in the post. All transcription models support diarization and context biasing. Context biasing takes key terms or free text to improve recall. Batch transcription covers 50 languages, including 24 official EU languages. How does the Voxtral voice agent SDK work? The SDK is built on LiveKit and runs 3 stages as 1 streaming pipeline. Realtime Transcribe 3 listens and detects when the caller stops speaking. A general LLM, such as Mistral Small 4, reasons and calls tools. Voxtral Speech 3 replies in the tone of the conversation so far. Each turn completes in under 1 second. The agent stops talking when the caller cuts in. It

Sobre la prioridad

Una ayuda automática para ordenar, basada en fuentes, palabras clave y entidades, en una escala de 1–12. Alta: 9–12; media: 6–8; baja: 1–5. No mide urgencia, verifica noticias ni representa respaldo editorial.

Más sobre este tema