With the support for NVIDIA GPUs launching in MAX 24.6, a number of people have already asked what hardware is compatible with MAX in this release. This thread is intended to be a reference for our officially-supported hardware, as well as a place for community discussions about hardware compatibili…

Older Nvidia drivers may be an issue, make sure you are on a current version! I have 560 working on my 4090, and the current “production level” release is 550. 535 has caused issues for at least one person.

For others reading this, I have an NVIDIA A2000 in my laptop. MAX recognizes the GPU (i.e. accelerator_count() == 1), but the calculations take slightly longer than running on the CPU (EDIT: using the nightly build to run the addition sample in custom_ops). Whether that’s because MAX isn’t optimized…

If you pass the --use-gpu flag to magic run MAX will execute on the GPU. That code doesn’t try to make a decision about which is “better”, CPU or GPU, at this point.

Does anyone know when the Apple GPU support comes?

That is definitely something on out minds, but we don’t have an ETA for it yet.

I get the following error if I try that: error: unexpected argument ‘–use-gpu’ found FWIW, it’s a laptop GPU, not a datacenter-grade GPU on the list of supported GPUs, so I’m not expecting it to be supported.

What is your full command line? It sounds like there is an argument parsing error, which might be unexpected.

magic run --use-gpu addition where addition is set in in the mojoproject.toml file as: [tasks] addition = { cmd=“mojo package kernels/ -o kernels.mojopkg && python addition.py”, env={ MODULAR_ONLY_USE_NEW_EXTENSIBILITY_API=“true” }}

Ahh , thanks! Sorry, I’ve confused things here. The --use-gpu option is a specific command line option for the llama3 pipeline, as documented here: Deploy Llama 3 on GPU with MAX Serve | Modular Docs . However, it is not a command line option for magic, which is why this error occurs (correctly). I …

Yeah, I did that. I’m responding to you and Brad in Discord. Let’s pick up the conversation there.

NVIDIA hardware support in MAX 24.6

MAX

BradLarson (Brad Larson) December 18, 2024, 6:28pm 13

I’ve created a new thread about the custom Mojo GPU operation examples, if people want to carry on discussions about those in that topic: [Experimental] Examples of custom CPU / GPU operations in Mojo

Topic		Replies	Views
It's here: MAX 24.6 and MAX GPU! :rocket: Official Announcements	0	223	December 17, 2024
Max doesn't support your current Nvidia GPU driver Mojo	11	189	May 11, 2026
Examples of programming GPU functions using the Mojo MAX Driver API MAX discussion , gpu , 25_1	5	666	April 26, 2025
MAX 24.6 and MAX GPU feedback MAX	2	344	December 19, 2024
Will Max support cerebras.ai hardware? MAX discussion , gpu , modular-content , 24_6	3	393	December 28, 2024

NVIDIA hardware support in MAX 24.6

Related topics