In the latest MAX nightlies, we’ve added the ability to program the GPUs on NVIDIA Jetson Orin single-board computers. You can use Magic to install MAX on these computers and build and run Mojo and Python code using MAX on them.
Jetson Orin computers combine a capable ARM CPU with an Ampere-generation NVIDIA GPU, and are widely used in robotics, vision, and control applications. The Jetson Orin Nano Developer Kit is particularly exciting as a system for learning GPU programming, because it’s $250 for a full computer with an Ampere GPU. Availability is a little limited at present, however, due to how popular they’ve been with hobbyists and developers.
We’re labeling this as experimental support, because we have only done a limited amount of testing against this hardware. In initial testing on a Jetson Orin Nano 8 GB (also listed as Orin Nano Super) system, all of our custom ops and GPU function examples build and run on the Jetson Orin Nano’s GPU. We believe this should also work on a full-size Jetson Orin board, as well as on the older Jetson Orin Nano 4 GB, but have not yet tested on those.
One known issue is present in the current MAX nightly:
- Models with bfloat16 weights fail to build and run on the Jetson Orin Nano, due to the ARM CPU paired with the NVIDIA GPU. This is being worked on.