Audio8-TTS-Realistic offers a small, open-source voice cloning model that balances multilingual accuracy with low deployment costs, making it a practical tool for developers.
AI-generated summary. Check the original reporting for context and accuracy.
Source excerpt
This is the available feed excerpt, which may be shortened or in the publisher’s original language.
Edge0 has released Audio8-TTS-Realistic, an open-weight text-to-speech model for zero-shot voice cloning. Audio8-TTS-Realistic is a 0.6B-parameter model that clones a voice from 1 reference clip and transcript. It supports 23 languages, 12 more than its predecessor. The weights and code ship under Apache 2.0. For developers, the catch is competitive multilingual accuracy at a size that is cheap to fine-tune and serve. TL;DR Size: 601M main-model parameters (codec excluded); up to 2,048 packed text/audio positions of context. Runs on: a CUDA GPU is recommended; smoke-tested on NVIDIA H20 in BF16. The paper reports 1.1 to 1.2 GiB peak memory on an Apple M2 CPU (INT4 ONNX). No Realistic ONNX export is public yet. Performance: ahead of larger open models on CV3, behind 4B-class models on MiniMax. Best: 4.86% average CV3 error across 9 languages, versus 7.73% for Qwen3-TTS-1.7B. Worst: 48.57% WER on Thai (CV3) and 31.35% CER on Cantonese (MiniMax). What is Audio8-TTS-Realistic? It is the second 0.6B release in Edge0’s Audio8 TTS family. It builds on Audio8-TTS-Preview-0.6b and keeps the same Transformers inference interface. The repository bundles the checkpoint, a 44.1 kHz neural audio codec, tokenizer, processor and custom code. It can also generate speech without a reference voice. New languages are Arabic, Finnish, Hindi, Indonesian, Malay, Norwegian, Portuguese, Russian, Swedish, Thai, Turkish and Vietnamese. How does the architecture work? The model uses a dual-autoregressive (DualAR) design inspired by Fish Audio S2 Pro. According to the technical research report, the slow branch is built on Qwen2.5 0.5B. It has 24 layers at width 896 and runs at about 21.5 frames per second. Each step predicts text tokens plus the first audio codebook. A shallow 4-layer fast branch then predicts the remaining 9 codebooks in parallel. Sequential compute therefore happens only at the frame level. How does Edge0 train for realism? The team argues that word error rate (
About priority
An automated sorting aid based on source trust, keywords, and entities, on a scale of 1–12. High: 9–12; medium: 6–8; low: 1–5. It does not measure urgency, verify reporting, or indicate editorial endorsement.
Samaya Sterling outperforms Claude Fable 5.1 on financial benchmarks at one-eleventh the cost, proving that co-training small models with their harnesses can dominate specific domains.
Baseten’s new joey-1 model offers ultra-cheap, high-speed classification for routing and safety checks, significantly reducing costs for high-volume AI applications.
Prime Intellect’s new kernel enables efficient training of MoE models by adding a fast backward pass, cutting GPU hours by up to 55% compared to standard frameworks.