vLLM
Kinference: Buoyant Releases Open Source Inference Control Plane for vLLM
Buoyant has released Kinference, an open source control plane for building inference platforms on vLLM and Kubernetes. According to the company, its KV-cache-aware load…
vLLM Adds Day-0 Support for Moonshot AI’s Kimi K3.1 Pro
vLLM has added day-0 support for Moonshot AI’s Kimi K3.1 Pro, an open-weight multimodal mixture-of-experts model with 2.8T parameters and a 1M-token context. The serving…