Build an LLM in MAX from scratch 📖

MAX
,
9

I am seeing this same issue, Marius. I have seen several people who are reporting issues past this point, so I am not certain why we are blocked.

Here is the output I’m seeing on an Intel i9 box with an Nvidia 4090 video card:

✅ Output shape is correct: (2, 4, 768)

❌ Functional test failed: Failed to compile and execute graph! Please file an issue. This error should have been caught at op creation time.

   Failed to compile and execute graph! Please file an issue. This error should have been caught at op creation time.

Here is information about the system:

(Modular) toddb@fidfast max-llm-book % lscpu
Architecture:                x86_64
  CPU op-mode(s):            32-bit, 64-bit
  Address sizes:             39 bits physical, 48 bits virtual
  Byte Order:                Little Endian
CPU(s):                      32
  On-line CPU(s) list:       0-31
Vendor ID:                   GenuineIntel
  Model name:                Intel(R) Core(TM) i9-14900KF
    CPU family:              6
    Model:                   183
    Thread(s) per core:      2
    Core(s) per socket:      24
    Socket(s):               1
    Stepping:                1
    CPU(s) scaling MHz:      16%
    CPU max MHz:             6000.0000
    CPU min MHz:             800.0000
    BogoMIPS:                6374.40

The OS:

(Modular) toddb@fidfast max-llm-book % uname -a
Linux fidfast 6.14.0-37-generic #37~24.04.1-Ubuntu SMP PREEMPT_DYNAMIC Thu Nov 20 10:25:38 UTC 2 x86_64 x86_64 x86_64 GNU/Linux

And the graphics card:

(Modular) toddb@fidfast max-llm-book % nvidia-smi
Wed Dec 17 08:05:01 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 575.57.08 Driver Version: 575.57.08 CUDA Version: 12.9 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA GeForce RTX 4090 On | 00000000:01:00.0 Off | Off |
| 0% 30C P8 7W / 450W | 40MiB / 24564MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 1742 G /usr/lib/xorg/Xorg 9MiB |
| 0 N/A N/A 1860 G /usr/bin/gnome-shell 10MiB |
+-----------------------------------------------------------------------------------------+

– end –

Anyone with help, please provide anything that you can think of.

Thanks,
Todd B.