ONNX Runtime
Microsoft brings Qwen3.8-27B agentic coding to developer PCs
Microsoft Foundry is bringing agentic coding to local developer hardware with Foundry Local, Qwen3.8-27B and GitHub Copilot integration. The setup is designed to keep…
NVIDIA Releases Open-Source C++ Samples for Local AI With TensorRT RTX
NVIDIA has published Do Inference Now (DIN) Deploy, an open-source collection of C++ samples that pairs ONNX Runtime with the NVIDIA TensorRT RTX execution provider.…
Qdrant's Rust cross-encoder library is only 1.1x faster than Python on small models
Qdrant has rewritten cross-encoder inference in Rust as a library called cross-encode-rs, and its own benchmark shows a modest gain: about 1.1x faster at the median than…