You.com’s Inference Router offers a cost-effective, high-uptime API for 12 open-weight models, enabling developers to deploy production-grade AI with zero data retention and US hosting.
AI-generated summary. Check the original reporting for context and accuracy.
Source excerpt
This is the available feed excerpt, which may be shortened or in the publisher’s original language.
You.com has launched Inference Router, a managed API for running open-weight models in production. The You.com Inference Router is an OpenAI-compatible service that routes requests across 12 live models. It bundles a 99.9% minimum uptime SLA and zero data retention (ZDR). It adds 100% US hosting and server-side web search. It is pay-as-you-go, with no platform fee. TL;DR Size: 12 live models, from GPT-OSS 120B (125K context) to Kimi K3 and Qwen3.8 Max (1M context). Kimi K3 is a 2.8T-parameter model; Qwen3.8 Max is a 2.4T MoE. Runs on: Fully managed. Requests hit You.com Inference Direct first, then fail over to US-hosted partners. No GPUs to manage. Performance: On You.com’s LiveNewsBench run, open-weight models plus You.com search matched frontier models at lower cost. Best: GLM-5.3 with You.com search scored 86.53%, at $0.0485 per question versus $0.0920 for Claude Sonnet 5.5 (self-reported). Worst: Per-token prices sit near market. Kimi K3 is $2.85/$14.25, only 5% below Together AI’s $3.00/$15.00. What is You.com Inference Router? It is one API for many open-weight models. The endpoint is https://api.you.com, with OpenAI-compatible and Anthropic-compatible routes. Existing SDK code moves over by changing the base URL and key. You.com team frames the problem around stalled migrations. Dev teams test open-weight models on aggregators, then hit security review. Reviewers ask about ZDR, US hosting, access controls and DPAs. Dedicated providers clear those bars, but usually with a large commitment. Inference Router targets that gap. How does the routing and failover work? Every request goes first to You.com Inference Direct, the company’s own inference capacity. If it is down or full, the request fails over to a vetted partner. The official post names Parasail, Wafer, Alibaba Cloud, Meta and Inception, with Prime Intellect coming soon. All are 100% US-hosted and must meet ZDR rules. Failover does not change the bill. Each model has 1 published per-token pr
About priority
An automated sorting aid based on source trust, keywords, and entities, on a scale of 1–12. High: 9–12; medium: 6–8; low: 1–5. It does not measure urgency, verify reporting, or indicate editorial endorsement.
TinyFish’s guides address critical production failures in AI search agents, offering architectural solutions to prevent incomplete data, costly retries, and resource overruns.
Google Cloud’s new Agent Compute Engine provides hardware-isolated microVMs for AI agents, ensuring secure, credential-free execution with high performance and density.
AI’s ability to model the human mind stems from mid-20th century engineering concepts that intentionally incorporated irrationality to enable machine thinking.