Support for Turing Architecture?

As an update to the topic, thanks to @ssslakter 's patch to add support: [stdlib] Support for RTX 2060 by ssslakter · Pull Request #4480 · modular/modular · GitHub the latest MAX nightly now has support for NVIDIA Turing-class GPUs! I tested this out myself on a T4 GPU (like those used in the free tier of Google Colab), and both Mojo GPU code and MAX Graphs worked well.

Full MAX models like Llama architectures aren’t fully functional on this GPU yet, because some of the kernels need to be updated to account for the Tensor Cores, etc. on the Turing GPUs. We definitely welcome patches to help extend the relevant kernels to work well on Turing GPUs.

3 Likes