El modelo MoE de 600B de código abierto de StepFun ofrece a los desarrolladores una opción autoalojable con alto contexto para tareas agénticas complejas, como programación y finanzas.
Resumen generado con IA. Consulta el original para comprobar el contexto y la precisión.
Extracto de la fuente
Este es el extracto disponible del feed. Puede estar abreviado o en el idioma original.
StepFun has released Step 5 Preview as open weights. FP8 and BF16 checkpoints are live on Hugging Face and ModelScope. Step 5 Preview is a sparse Mixture-of-Experts model from StepFun built for long-horizon agentic work. It has 600B total parameters, 27B active per token and up to 1M tokens of context. For developers, this is a new self-hostable option for coding agents, document analysis and finance workflows. TL;DR Size: 600B total, 27B active per token, up to 1M-token context. Runs on: data-center GPUs only. FP8 needs 4x B300 or 8x H200. BF16 needs 8x B300 or 16x H200. Performance: near open-weight peers GLM-5.3 and Kimi K3 on coding. Behind GPT-6 Astra and Claude Opus 5. Best: 88.3% on AA-LCR long-context reasoning (Artificial Analysis). Worst: 33.3% on Terminal-Bench 4.0, versus 41.9% for GLM-5.3. What is Step 5 Preview? Step 5 Preview is StepFun’s flagship model for agentic work. StepFun positions it for software engineering, professional knowledge work and finance. The model navigates large codebases, coordinates multi-file changes, runs code and iterates on results. It also analyzes long documents, charts, screenshots and video to produce structured reports. The API launched September 20. Weights followed on October 14. How does the architecture work? Only 27B of the 600B parameters activate per token. StepFun’s tech team adds the internals: Depth: 92 transformer blocks in a narrow, deep design. Attention mix: gated sliding-window attention and full attention layers, interleaved 3:1. Sparse GQA: full-attention layers pick 4,096 history tokens per query, scored in blocks of 8. Speculative decoding: an MTP-3 head gives roughly 30% end-to-end speedup. Training: FP8 mixed precision, with RL on million-level verifiable agentic environments. How does Step 5 Preview perform on benchmarks? StepFun ran its own evaluations at the High reasoning setting. Rivals in its chart ran at Max effort, so the comparison is not like-for-like. Results reported o
Sobre la prioridad
Una ayuda automática para ordenar, basada en fuentes, palabras clave y entidades, en una escala de 1–12. Alta: 9–12; media: 6–8; baja: 1–5. No mide urgencia, verifica noticias ni representa respaldo editorial.
Voxtral 3 de Mistral unifica las capacidades de transcripción de voz a texto, síntesis de voz y agentes de voz en una única API, simplificando el desarrollo de aplicaciones de voz en tiempo real.
llm-d 1.0 de Google optimiza la inferencia de IA a gran escala en Kubernetes, resolviendo los problemas de equilibrado de carga para cargas de trabajo de agentes autoalojados y aprendizaje por refuerzo.
La nueva herramienta de simulación generativa de NVIDIA transforma la formación en cirugía clínica al crear escenarios realistas impulsados por IA que mejoran la educación médica y la pericia quirúrgica.