llm-d
CoreWeave joins Red Hat's llm-d open source project as a founding member
CoreWeave has become a founding member of Red Hat's new llm-d open source project, alongside IBM Research, Google and NVIDIA. According to CoreWeave, the project aims to…
For developersIBM Research says llm-d 1.0 hardens open-source AI inference
IBM Research has published a blog post titled "llm-d 1.0 hardens open-source AI inference for production", pointing to a 1.0 release of llm-d aimed at production use.…
llm-d 1.0 arrives with production features for open AI inference at scale
The open source llm-d project has released version 1.0, a milestone aimed at helping organizations run large language model inference more efficiently in production.…
Red Hat AI 3.5 lets chat and batch share one GPU without latency hits
Red Hat AI 3.5 makes priority-aware serving generally available, letting chat, batch and agentic traffic share one GPU pool while interactive requests go first.…
llm-d enters CNCF Sandbox as open source push for distributed AI inference grows
The open source project llm-d, built to orchestrate and scale distributed inference across accelerator infrastructure, is entering the Cloud Native Computing Foundation…