Triton

PyTorch Helion can now tune NVIDIA compiler controls alongside GPU kernel settings
PyTorch's Helion autotuner can now search compiler settings below the kernel level together with its usual kernel configurations. The settings come from NVIDIA's…
For developersPyTorch's FBTriton Kernels for Table Batched Embeddings Beat Legacy CUDA
PyTorch has published a technical walkthrough of FBTriton, a Triton-based implementation of the Table Batched Embedding (TBE) forward and backward kernels used in…