Baidu’s open-source Unlimited OCR 2 enables efficient, single-request parsing of massive documents on a single GPU, significantly lowering the barrier for large-scale text extraction.
AI-generated summary. Check the original reporting for context and accuracy.
Source excerpt
This is the available feed excerpt, which may be shortened or in the publisher’s original language.
Baidu has released Unlimited OCR 2, an open-source OCR model built for very long documents. The 3B model parses books, filings and reports of hundreds of pages in one request. Its core change is SR-SWA, a sparse attention scheme that keeps per-step decoding cost nearly flat. Weights ship under the MIT license, with code on GitHub. TL;DR Size: 3.34B parameters. Active parameters not disclosed. Max position length 131,072 tokens. Runs on: 1 CUDA GPU in BF16. Baidu tested on an NVIDIA A800-80GB. BF16 weights total about 6.7 GB. Performance: first place on both multi-page benchmarks Baidu tested, against 9 other models (self-reported). Best: 77.1 overall on MarathonDocBench (hundreds of pages). The next model, Kimi-K3, scores 33.7. Worst: 48.2 on heading hierarchy (TEDS) on MarathonDocBench, its lowest sub-score. What is Unlimited OCR 2? Unlimited OCR 2 is a 3B vision-language model from Baidu that turns ordered page images into structured text. Output covers text, tables, formulas, figures, headings and reading order. It succeeds Unlimited-OCR, released in June 2026 to push DeepSeek-OCR further. The config keeps a DeepSeek-OCR style layout. A SAM ViT-B plus CLIP-L encoder feeds a 12-layer mixture-of-experts decoder. Each token routes to 6 of 64 experts, plus 2 shared experts. The DeepSeek-OCR paper describes this decoder as DeepSeek3B-MoE-A570M. Baidu does not state an active count for version 2. In multi-page mode, each page costs 273 image tokens. How does SR-SWA work? Full attention cost grows quadratically with sequence length. During decoding, each new token scans a longer KV cache. At 273 image tokens per page, 100 pages add 27,300 input tokens before any output. SR-SWA stands for Sparse Reference Sliding Window Attention. It compresses text-visual attention into a fixed set of working references. Baidu’s model card gives 512 tokens as the example size. The config pairs a 128-token local window with top-16 selection over 32-token blocks. That is 16 b
About priority
An automated sorting aid based on source trust, keywords, and entities, on a scale of 1–12. High: 9–12; medium: 6–8; low: 1–5. It does not measure urgency, verify reporting, or indicate editorial endorsement.
d3-ultra offers a single, open-weight model that handles routing, classification, and visual tasks simultaneously, simplifying AI infrastructure by replacing multiple specialized models with one efficient call.
MIT’s significant presence at Climate Week NYC 2026 highlights its active role in connecting global stakeholders to accelerate climate solutions and spur collective action.