PyTorch 2.0: next generation release Summary: torch.compile is the main API for PyTorch 2.0, which wraps your model and returns a compiled model. TorchInductor with Nvidia and AMD GPUs will rely on OpenAI Triton deep learning compiler to generate performant code and hide low level hardware details. OpenAI Triton-generated kernels achieve performance that’s on par with hand-written kernels and specialized cuda libraries such as cublas. https://pytorch.org/blog/pytorch-2.0-release/