SignalStack
Volver a noticias

Import AI 478: Matemáticas para la alineación; ProgramBench; y Mirendil muestra lo que significa la RSI

Leer original

Resumen con IA

La formalización de las matemáticas con IA podría mejorar la seguridad de la alineación, mientras que los nuevos benchmarks y los conocimientos sobre la RSI destacan el panorama en evolución de la investigación y las capacidades de la IA.

Resumen generado con IA. Consulta el original para comprobar el contexto y la precisión.

Extracto de la fuente

Este es el extracto disponible del feed. Puede estar abreviado o en el idioma original.

Welcome to Import AI, a newsletter about AI research. Import AI runs on arXiv, cappuccinos, and feedback from readers. If you’d like to support this, please subscribe.Subscribe nowHow math could help alignment:…What the “industrialization of mathematics” means for safety…AI safety startup Resolution (formerly known as Sequent, Import AI 461) has published work on how it has automatically formalized some mathematical statements related to statistical learning theory. Specifically, the team has autoformalized the resolution of singularities, which they believe “lays the groundwork for further automated research into the relationship between loss landscape geometry and generalization.”How they did it: I’ll skip over the math and concentrate on how they did it, which gives us some broader lessons for how people are using AI systems to push on the frontier of knowledge. A Resolution researcher “started by working with agents to develop two plans: a high-level, human-interpretable version and a detailed (112-page) plan divided into atomic steps that closely followed the existing literature,” they write. The researcher “then deputized an orchestrator agent to carry out the plan, spinning up agents to do pen-and-paper math, write Lean, and handle support functions like checking that things were staying on track… the execution phase required little scaffolding beyond the initial plan and some agent skills distilled from earlier internal autoformalization efforts.”$135k for math formalization: The work took about a week, taking “on the order of 100B input tokens (90% cache reads) and about 300 million output tokens (totaling an estimated $135,000 in token spend), and produced about 600k lines of Lean.” Now that they’ve done this, they’ve been able to accelerate some other aspects of their research: “We have already seen both benefits from autoformalization in using this library to extend parts of singular learning theory. Formalizing resolution of singularities lets us aut

Sobre la prioridad

Una ayuda automática para ordenar, basada en fuentes, palabras clave y entidades, en una escala de 1–12. Alta: 9–12; media: 6–8; baja: 1–5. No mide urgencia, verifica noticias ni representa respaldo editorial.

Más sobre este tema