La nueva API de TTS de AssemblyAI, con un costo de 15 USD por millón de caracteres, ofrece una síntesis de voz asequible y de baja latencia para agentes telefónicos en vivo, simplificando el desarrollo al unificar la conversión de voz a texto y de texto a voz bajo un solo proveedor.
Resumen generado con IA. Consulta el original para comprobar el contexto y la precisión.
Extracto de la fuente
Este es el extracto disponible del feed. Puede estar abreviado o en el idioma original.
AssemblyAI has released AssemblyAI-TTS-1, its first text-to-speech model, now generally available. The AssemblyAI-TTS-1 text-to-speech API targets voice agents running on live phone calls. In that setting, latency and pronunciation decide whether a caller stays on the line. Pricing is $15 per 1M characters, with no annual contract and no concurrency tier to buy. For developers already using AssemblyAI speech-to-text, it closes the voice loop with one vendor. TL;DR Size: It is a hosted API model. Runs on: AssemblyAI’s cloud only, in the US (us-east-1) or EU (eu-north-1). No open weights or on-prem option. Any client with HTTP or WebSocket works. Performance: Ties ElevenLabs v4 on entity accuracy in AssemblyAI’s tests, at under 1/5 of its price. Best: 47 ms median time to first byte across 6 models in AssemblyAI’s API test (self-reported). Worst: 159 ms median streaming latency on Cekura’s independent benchmark, 8th of 19 timed models. Bottom line: Best: $15 per 1M characters with unlimited concurrency. Worst: no SSML, speed control, pronunciation dictionaries or emotion tags yet. What is AssemblyAI-TTS-1? AssemblyAI-TTS-1 is a streaming text-to-speech model from AssemblyAI that turns agent replies into speech for live calls. It was trained on millions of hours of audio, including real conversational data. Most TTS models represent audio as discrete tokens. AssemblyAI says TTS-1 operates on continuous audio representations instead. The AssemblyAI claims this improves realism and cuts time to first spoken audio. The launch includes a library of 4,000+ voices and instant voice cloning. A clone needs a short recording and a confirmation of the speaker’s permission. The clone in the launch post used 24 seconds of audio. Six languages are supported at launch: English, Spanish, French, German, Italian and Portuguese. How do developers integrate AssemblyAI-TTS-1? There are 3 interfaces: an HTTP API, a WebSocket API and an OpenAI-compatible route. The WebSocke
Sobre la prioridad
Una ayuda automática para ordenar, basada en fuentes, palabras clave y entidades, en una escala de 1–12. Alta: 9–12; media: 6–8; baja: 1–5. No mide urgencia, verifica noticias ni representa respaldo editorial.
Hermit permite a los desarrolladores adaptar agentes de IA a nuevas tareas sin necesidad de ajustar modelos ni bifurcar el código, optimizando así los flujos de trabajo de desarrollo.
El nuevo modelo de voz de Block, entrenado exclusivamente con audio y sin texto, ofrece una alternativa más rápida y natural a los agentes de voz basados en texto actuales.
El modelo abierto Nemotron 3.5 Transcribe de NVIDIA integra la transcripción de voz a texto, la identificación de hablantes y la traducción en un único modelo eficiente, simplificando el procesamiento de audio multilingüe para los desarrolladores.