AWS announces TorchNeuron: Native PyTorch Support for AWS Trainium (Public Beta)

AWS Launches TorchNeuron Public Beta

AWS has launched the public beta of TorchNeuron, an open-source native PyTorch backend for AWS Trainium. Trainium is a series of AI chips designed for high-performance and cost-efficient deep learning AI training and inference workloads.

TorchNeuron allows AI scientists and researchers to experiment and build models with PyTorch natively on Trainium.

Key Features

• Native PyTorch Support: Developers can run PyTorch code on Trainium by switching to .to('neuron') while maintaining full PyTorch compatibility.
• Integration with Neuron Kernel Interface (NKI): Enables custom operators and performance optimization for Trainium hardware.

What to do

• Explore TorchNeuron on the TorchNeuron GitHub repo.
• Use TorchNeuron on Amazon EC2 Trainium2 and Trainium3 instances.
• Learn more on the AWS Neuron page.

Source: AWS release notes

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.