Amazon Launches Open-Source TorchNeuron Tool to Run PyTorch on Custom Trainium Chips

Amazon has launched TorchNeuron, a free and open-source software tool designed to let developers run PyTorch applications directly on its proprietary Trainium AI chips without rewriting code. Developed by Amazon's Annapurna Labs, the tool requires only a single configuration change, directly challenging Nvidia's dominant CUDA software platform. The tool is scheduled to enter public beta on October 20. Amazon reported that more than 30 early customers across robotics, world models, and voice AI have already adopted the software, with voice AI provider Deepgram achieving 70% more audio processing per dollar.