Los nuevos chips TPU 8i Max y 8tx de Google amplían las capacidades de la infraestructura de IA al ofrecer una mayor densidad de cómputo para modelos grandes y una seguridad mejorada para la inferencia confidencial.
Resumen generado con IA. Consulta el original para comprobar el contexto y la precisión.
Este es el extracto disponible del feed. Puede estar abreviado o en el idioma original.
Google has added two new systems to its eighth-generation TPU lineup. TPU 8i Max targets massive context windows and rack density. TPU 8tx targets secure, confidential inference. Google TPU 8i Max is a dual-chip package built from 2 TPU 8i chips. Both arrive alongside TPU 8t and TPU 8i, announced in April. TL;DR Size: TPU 8i Max = 2 TPU 8i chips in 1 package. TPU 8tx = TPU 8t silicon plus 5th Gen AMD EPYC hosts. Runs on: Google Cloud TPU systems. Performance: 8i Max doubles TPU 8i compute, SRAM and HBM bandwidth. 8tx cuts latency up to 2x versus TPU 8t. Best: 2x the silicon in the existing rack footprint (TPU 8i Max). Worst: No absolute specs, benchmarks, prices or regions published for either system. What did Google announce? Google announced both systems today. These are new system configurations, not new chips. Google reuses its existing eighth-generation silicon and changes packaging, hosts, memory and networking around it. How does TPU 8i Max work? TPU 8i Max attacks the memory wall. Google team combines 2 low-latency TPU 8i chips onto 1 package. The result doubles compute, SRAM and HBM bandwidth compared with TPU 8i. Each TPU 8i chip is rated at 10.1 PFLOPS of FP4, 288 GB of HBM and 8,601 GB/s. It also carries 384 MB of on-chip SRAM. Doubling those figures implies about 20.2 PFLOPS FP4, 768 MB SRAM and 17.2 TB/s per package. Google did not publish these absolute figures. It also did not state HBM capacity for TPU 8i Max. TPU 8i Max fits twice the silicon in the existing rack footprint. Google positions it for agents working across whole codebases or hours of video. What makes TPU 8tx different? TPU 8tx is built for regulated enterprises and governments. It keeps data and model weights protected even while in active use. Normally, data must be decrypted in memory during processing. TPU 8tx uses the same silicon as TPU 8t. It pairs that silicon with 5th Gen AMD EPYC CPU hosts. It also adopts the Boardfly network from TPU 8i. Google claims up to
Una ayuda automática para ordenar, basada en fuentes, palabras clave y entidades, en una escala de 1–12. Alta: 9–12; media: 6–8; baja: 1–5. No mide urgencia, verifica noticias ni representa respaldo editorial.
La disponibilidad de ChatGPT Enterprise en AWS Marketplace simplifica la adquisición empresarial al aprovechar las relaciones de compra y facturación existentes de AWS.
ERNIE Evolve de Baidu automatiza la optimización de código de IA, superando los benchmarks anteriores y mejorando la eficiencia de inferencia para su próximo modelo ERNIE-5.5-Flash.
Este conjunto de datos sintético ofrece perfiles demográficos y financieros realistas de Japón, permitiendo que los modelos de IA comprendan mejor y atiendan el mercado y la población únicos de Japón.