TorchTitan
TorchTitan adds RL training with TitanRL and support for new frontier models
PyTorch's TorchTitan platform has gained reinforcement learning support through a new component called TitanRL, along with native support for several new open-weights…
Google and Meta bring TorchTitan to TPUs with PyTorch-native training recipes
Google has released TorchTitan TPU, a fork of Meta's TorchTitan that lets developers train PyTorch models on Google Cloud TPUs with ready-made distributed recipes.…
Zephon brings elastically deterministic data loading to PyTorch's TorchTitan
PyTorch has introduced Zephon, a data loader for TorchTitan that produces the same global batches no matter how many GPUs a job runs on, while tokenizing, packing…