B200
Ai2 replaces priority scheduler with GPU time budgets to fund high-impact research
Ai2 has replaced the priority-based scheduler on its GPU clusters with a system built on GPU time budgets, hierarchical fair-share allocation and a time-slicing…
For developersPyTorch's FBTriton Kernels for Table Batched Embeddings Beat Legacy CUDA
PyTorch has published a technical walkthrough of FBTriton, a Triton-based implementation of the Table Batched Embedding (TBE) forward and backward kernels used in…
Baseten's AI-built inference engine beats vLLM by up to 90% on Qwen decode
Baseten says an inference engine generated by an AI agent outperformed vLLM 0.25.1 by up to 90% on single-stream decode speed for Qwen-3.6-35B-A3B in NVFP4 precision on…