New: AI API Cost Calculator — compare GPT, Claude, Gemini, Grok, Llama, DeepSeek & Kimi pricing live
Developers · News

NVIDIA, AMD, Intel and Google Just Formed the SGLang Consortium

By ToolsDig Research · Updated November 13, 2026 · How we research

Nothing here is sponsored — no affiliate links on this page. Every fact below comes from the LMSYS Org announcement of November 12, 2026, as published by BusinessWire. We have not run SGLang at scale hands-on, and this is researched analysis, not hands-on testing.

Rows of server racks with glowing GPU hardware and streams of light flowing between them in a dark data center

Eight companies that normally compete on silicon just agreed to steer the same software project. On November 12, 2026, LMSYS Org announced the SGLang Consortium in the opening keynote of the first SGLang Summit, running November 12-13 at the Fort Mason Center in San Francisco with more than 100 speakers. The founding members are NVIDIA, AMD, Intel, Google, Meta, Cloudflare, Modal and RadixArk.

🔍 How we put this together

We used the BusinessWire release of November 12, 2026 ("LMSYS Org Launches SGLang Consortium with NVIDIA, AMD, Intel, Google, Meta, Cloudflare, Modal, and RadixArk to Advance Open-Source AI Inference"). Where something is a vendor or industry projection, we say so.
🏆 Verdict: This is a bet on the boring half of AI. Training made the models; serving decides who can afford to run them. Eight rivals agreeing to steer the serving layer together is a notable day for open-source infrastructure — but nothing ships with the announcement, so judge it on the public updates and joint engineering work that follow, not on the launch itself.

Why inference, why now

Training gets the keynotes. Serving pays the bills.

Deloitte expects inference to be about two-thirds of all AI compute in 2026, up from about half in 2025. Every chatbot reply, every agent step, every image your app generates runs through an inference engine, and the cost of that serving layer is now the biggest line item in most AI budgets. The companies that build the hardware and the companies that run the biggest deployments all feel the same pressure: the software that serves models has to get more efficient, because the data-center build-out can't keep up on its own.

That's the problem this consortium is aimed at. Ying Sheng — co-author of the original SGLang paper and co-founder and CEO of RadixArk — put it plainly at the launch: the teams running SGLang at the largest scale see what inference needs next, and with data-center build challenges everywhere, software efficiency matters enormously.

What SGLang is

SGLang is a full-stack inference engine and part of the PyTorch ecosystem. It runs on hundreds of thousands of GPUs and powers large production deployments at Meta, Microsoft, Google, Amazon, Thinking Machines Lab, Cloudflare, Reflection and Modal. If you've served an open model at any real scale, there's a fair chance SGLang was somewhere in your stack, whether you knew it or not.

The consortium gives that project a formal governance layer it didn't have before. What it does, in practice:

That last point is the one to watch. The consortium is a governance and engineering partnership, not a takeover. The maintainers still decide what lands in the codebase. That's the right design for an open-source project — and it also means the consortium's influence shows up gradually, in roadmap decisions and joint engineering, not in a single release.

Ian Buck, NVIDIA's vice president of hyperscale and HPC, framed the hardware side of it the same way: better software gets more performance out of NVIDIA compute, open models let developers build, and lower inference costs make AI more accessible. When the company that sells the GPUs is arguing for cheaper serving, the economics have clearly shifted.

The catches

Nothing ships with this announcement. That's the first thing to be honest about.

Should you care?

It depends on where you sit:

What we'd actually do

Nothing this week. There's nothing to install, nothing to migrate, nothing to benchmark yet. If SGLang is in your stack, the move is to watch the first public update and the first joint-engineering deliverable — that's when an announcement becomes a track record.

The honest read is that this is a bet on the boring half of AI. Training made the models; serving decides who can afford to run them. Eight rivals just agreed that the serving layer is worth steering together. That's a notable day for open-source infrastructure, even if your stack doesn't change before lunch.

What we don't know yet

Sources: BusinessWire, "LMSYS Org Launches SGLang Consortium with NVIDIA, AMD, Intel, Google, Meta, Cloudflare, Modal, and RadixArk to Advance Open-Source AI Inference" (November 12, 2026). Inference-share figures are Deloitte's, as cited in the release. All other facts are from the release.