# \#discussion **URL:** https://forum.modular.com/tag/discussion/2.md [Latest](https://forum.modular.com/latest.md) · [Categories](https://forum.modular.com/categories.md) · [Tags](https://forum.modular.com/tags.md) --- ## [MAX vs vLLM for HPC inference farm](https://forum.modular.com/t/max-vs-vllm-for-hpc-inference-farm/3464)
**Author:** [@Curious](https://forum.modular.com/u/Curious)\ **Replies:** 3\ **Last updated:** [September 30, 2026, 7:41pm UTC](https://forum.modular.com/t/max-vs-vllm-for-hpc-inference-farm/3464 "2026-09-30T19:41:36Z")
I am looking to create an inference farm on a Docker HPC host with 4 nodes with 4 H100s each. I asked Gemini and it said MAX loses to vLLM for more users and is more geared towards local deployments. I took this person… --- ## [313t and 314t Python Interop](https://forum.modular.com/t/313t-and-314t-python-interop/3057)
**Author:** [@Synaptic724](https://forum.modular.com/u/Synaptic724)\ **Replies:** 3\ **Last updated:** [September 28, 2026, 2:02pm UTC](https://forum.modular.com/t/313t-and-314t-python-interop/3057 "2026-09-28T14:02:00Z")
Hey Mojo team, I’m an AI Native python framework developer and I would love to use your language with my frameworks as plugins for my AI Native tooling. I haven’t released my package as of yet but they’ll be coming out … --- ## [Mojagg: A port of Numbagg to Mojo](https://forum.modular.com/t/mojagg-a-port-of-numbagg-to-mojo/3522)
**Author:** [@josephnowak](https://forum.modular.com/u/josephnowak)\ **Replies:** 0\ **Last updated:** [September 22, 2026, 10:05am UTC](https://forum.modular.com/t/mojagg-a-port-of-numbagg-to-mojo/3522 "2026-09-22T10:05:38Z")
Hi all, I wanted to share my project called Mojagg, which is a port of Numbagg—a project used by the Xarray community to accelerate various algorithms using Numba. You can install it via PyPI. I decided to port Numbagg… --- ## [Bare-metal Mojo on a $4 microcontroller — a pure-Mojo RP2040 firmware + SDK](https://forum.modular.com/t/bare-metal-mojo-on-a-4-microcontroller-a-pure-mojo-rp2040-firmware-sdk/3298)
**Author:** [@Hundo](https://forum.modular.com/u/Hundo)\ **Replies:** 14\ **Last updated:** [September 21, 2026, 6:36pm UTC](https://forum.modular.com/t/bare-metal-mojo-on-a-4-microcontroller-a-pure-mojo-rp2040-firmware-sdk/3298 "2026-09-21T18:36:28Z")
Mojo is usually pointed at GPUs and AI kernels. I wanted to see how far the other direction goes, so I wrote a bare-metal firmware and peripheral SDK for the Raspberry Pi Pico (RP2040, a dual Cortex-M0+) in pure Mojo — n… --- ## [Pattern matching + Enum proposals](https://forum.modular.com/t/pattern-matching-enum-proposals/3473)
**Author:** [@owenhilyard](https://forum.modular.com/u/owenhilyard)\ **Replies:** 46\ **Last updated:** [September 16, 2026, 10:53am UTC](https://forum.modular.com/t/pattern-matching-enum-proposals/3473 "2026-09-16T10:53:31Z")
cc @clattner as author --- ## [Mojolearn: bitwise identical machine learning across GPUs and CPUs, written in Mojo](https://forum.modular.com/t/mojolearn-bitwise-identical-machine-learning-across-gpus-and-cpus-written-in-mojo/3497)
**Author:** [@ajhendel](https://forum.modular.com/u/ajhendel)\ **Replies:** 0\ **Last updated:** [September 15, 2026, 1:42pm UTC](https://forum.modular.com/t/mojolearn-bitwise-identical-machine-learning-across-gpus-and-cpus-written-in-mojo/3497 "2026-09-15T13:42:25Z")
Hi all, I’ve been building Mojolearn, a machine learning library written in Mojo with a Python API. The idea is to run the same supported AI workload on Apple, NVIDIA or AMD GPUs or Intel, AMD and Apple CPUs and get exa… --- ## [Protocol Buffers serializer for Mojo](https://forum.modular.com/t/protocol-buffers-serializer-for-mojo/3480)
**Author:** [@leo-gan](https://forum.modular.com/u/leo-gan)\ **Replies:** 0\ **Last updated:** [September 10, 2026, 4:36pm UTC](https://forum.modular.com/t/protocol-buffers-serializer-for-mojo/3480 "2026-09-10T16:36:45Z")
I’ve created the Protocol Buffers serializer for Mojo. Here is the documentation. I would appreciate suggestions and contributions. Thanks! --- ## [Does Mojo support cross-compilation for GPU targets on non-GPU platforms?](https://forum.modular.com/t/does-mojo-support-cross-compilation-for-gpu-targets-on-non-gpu-platforms/3465)
**Author:** [@yinghao](https://forum.modular.com/u/yinghao)\ **Replies:** 5\ **Last updated:** [September 8, 2026, 10:15pm UTC](https://forum.modular.com/t/does-mojo-support-cross-compilation-for-gpu-targets-on-non-gpu-platforms/3465 "2026-09-08T22:15:09Z")
My current local machine doesn’t meet Mojo’s GPU runtime requirements, and I’m currently unable to compile on it. Given that most modern programming languages and compilers support cross-compilation, I was wondering: doe… --- ## [Data Visualization in pure Mojo: canvas\_mojo and dataviz\_mojo](https://forum.modular.com/t/data-visualization-in-pure-mojo-canvas-mojo-and-dataviz-mojo/3434)
**Author:** [@randyzwitch](https://forum.modular.com/u/randyzwitch)\ **Replies:** 14\ **Last updated:** [September 4, 2026, 1:01pm UTC](https://forum.modular.com/t/data-visualization-in-pure-mojo-canvas-mojo-and-dataviz-mojo/3434 "2026-09-04T13:01:17Z")
Hey everyone…first post here, but we may have interacted in some other open-source community before (Python, Julia, R, Streamlit, etc.) :slight\_smile: As part of taking stock of what I actually know as a software develo… --- ## [Float64 accuracy of std.math on CPU, measured against the system libm (Mojo 1.0.0)](https://forum.modular.com/t/float64-accuracy-of-std-math-on-cpu-measured-against-the-system-libm-mojo-1-0-0/3460)
**Author:** [@zapazite](https://forum.modular.com/u/zapazite)\ **Replies:** 2\ **Last updated:** [September 2, 2026, 10:41pm UTC](https://forum.modular.com/t/float64-accuracy-of-std-math-on-cpu-measured-against-the-system-libm-mojo-1-0-0/3460 "2026-09-02T22:41:59Z")
Float64 accuracy of std.math on CPU, measured against the system libm (Mojo 1.0.0) Hello, A few months ago, on a 1.0 beta, I ran into a small numerical discrepancy in exp/log while gradient-checking some derivatives I h… --- ## [Official Modular training and inference library in mojo?](https://forum.modular.com/t/official-modular-training-and-inference-library-in-mojo/3461)
**Author:** [@timo.david](https://forum.modular.com/u/timo.david)\ **Replies:** 1\ **Last updated:** [September 2, 2026, 12:27pm UTC](https://forum.modular.com/t/official-modular-training-and-inference-library-in-mojo/3461 "2026-09-02T12:27:27Z")
Are there any plans to have a mojo library for both training and inference, like pytorch or tensorflow? Now that mojo reached 1.0 and that we can write gpu kernels in pure mojo, this looks like a natural next step. I kn… --- ## [Trying to untangle the strategy behind Qualcomm open-sourcing Mojo (Feedback welcome)](https://forum.modular.com/t/trying-to-untangle-the-strategy-behind-qualcomm-open-sourcing-mojo-feedback-welcome/3427)
**Author:** [@InsiderCrush](https://forum.modular.com/u/InsiderCrush)\ **Replies:** 1\ **Last updated:** [August 24, 2026, 2:08pm UTC](https://forum.modular.com/t/trying-to-untangle-the-strategy-behind-qualcomm-open-sourcing-mojo-feedback-welcome/3427 "2026-08-24T14:08:17Z")
Hey everyone, I’m not a compiler engineer or a semiconductor insider, but I spent some time trying to wrap my head around the recent Qualcomm–Modular deal. To an outsider, spending $3.9B and then immediately open-sourci… --- ## [Is there a MAX roadmap?](https://forum.modular.com/t/is-there-a-max-roadmap/3403)
**Author:** [@Curious](https://forum.modular.com/u/Curious)\ **Replies:** 4\ **Last updated:** [August 17, 2026, 12:36am UTC](https://forum.modular.com/t/is-there-a-max-roadmap/3403 "2026-08-17T00:36:42Z")
Is there a MAX equivalent of the Mojo Roadmap or is MAX’s faith linked to Mojo so we do not need one? --- ## [Merging errors during cleanup failures](https://forum.modular.com/t/merging-errors-during-cleanup-failures/3397)
**Author:** [@DenisNavarro](https://forum.modular.com/u/DenisNavarro)\ **Replies:** 10\ **Last updated:** [August 16, 2026, 8:39pm UTC](https://forum.modular.com/t/merging-errors-during-cleanup-failures/3397 "2026-08-16T20:39:45Z")
Hello. Thanks for your work on the Mojo language. Right now, Mojo does not merge exceptions by default when multiple exceptions are raised, especially during cleanup failures. May it change in a future version of Mojo? … --- ## [Does MAX distribute inference accross PBS nodes](https://forum.modular.com/t/does-max-distribute-inference-accross-pbs-nodes/3400)
**Author:** [@Curious](https://forum.modular.com/u/Curious)\ **Replies:** 4\ **Last updated:** [August 15, 2026, 12:09am UTC](https://forum.modular.com/t/does-max-distribute-inference-accross-pbs-nodes/3400 "2026-08-15T00:09:43Z")
Suppose I qsub 5 compute nodes each having CPUs and GPUs, I now use MPI to distribute my job accross them but can custom ops and MAX do the same or is there a Mojo std.distributed or something of that sort? --- ## [Syntax Proposal: Replace \`thin\` with \`{}\`](https://forum.modular.com/t/syntax-proposal-replace-thin-with/3383)
**Author:** [@yinon](https://forum.modular.com/u/yinon)\ **Replies:** 14\ **Last updated:** [August 13, 2026, 5:26pm UTC](https://forum.modular.com/t/syntax-proposal-replace-thin-with/3383 "2026-08-13T17:26:11Z")
Syntax Proposal: Replace thin with {} Currently, a non-capturing function pointer type is written as def(Int) thin -\> Int. We propose replacing the thin keyword with an empty capture list {} (e.g. def(Int) {} -\> Int). f… --- ## [\[Proposal\] The Risk Effect: Reducing the Verbosity of Unsafe Naming Convention](https://forum.modular.com/t/proposal-the-risk-effect-reducing-the-verbosity-of-unsafe-naming-convention/3382)
**Author:** [@yinon](https://forum.modular.com/u/yinon)\ **Replies:** 4\ **Last updated:** [August 10, 2026, 11:39pm UTC](https://forum.modular.com/t/proposal-the-risk-effect-reducing-the-verbosity-of-unsafe-naming-convention/3382 "2026-08-10T23:39:28Z")
The Risk Effect: Reducing the Verbosity of Unsafe Naming Convention 1. The Problem: The Burden of Naming-Based Safety Mojo uses the unsafe\_ prefix in function and method names (e.g., Pointer.unsafe\_offset) to track unsaf… --- ## [Parallelism\_level](https://forum.modular.com/t/parallelism-level/3378)
**Author:** [@reymono](https://forum.modular.com/u/reymono)\ **Replies:** 1\ **Last updated:** [August 10, 2026, 11:25pm UTC](https://forum.modular.com/t/parallelism-level/3378 "2026-08-10T23:25:22Z")
Nice to see Mojo reach v.1.0 I’m comparing Mojo to C on a mandelbrot task. This on a Macbook Air M5. SIMD works well, but multi-threaded performance suffers and I think it is because parallelism\_level()is limited to 4… --- ## [\[Proposal\] Parameterized Deinitialization for Linear Types](https://forum.modular.com/t/proposal-parameterized-deinitialization-for-linear-types/3372)
**Author:** [@yinon](https://forum.modular.com/u/yinon)\ **Replies:** 5\ **Last updated:** [August 10, 2026, 8:21pm UTC](https://forum.modular.com/t/proposal-parameterized-deinitialization-for-linear-types/3372 "2026-08-10T20:21:04Z")
Linear Types: Parameterized Deinitialization 1. The Problem: The API Duplication Burden Mojo has introduced elegant solutions to unify common language dualities—for example, raises Never unifies raising and non-raising f… --- ## [\[Proposal\] LSP Inlay Hints for \`raises\`](https://forum.modular.com/t/proposal-lsp-inlay-hints-for-raises/3373)
**Author:** [@yinon](https://forum.modular.com/u/yinon)\ **Replies:** 2\ **Last updated:** [August 8, 2026, 9:10pm UTC](https://forum.modular.com/t/proposal-lsp-inlay-hints-for-raises/3373 "2026-08-08T21:10:38Z")
Proposal: LSP Inlay Hints for raises Background: What are Inlay Hints? Inlay hints are a feature provided by the Language Server Protocol (LSP) and supported by modern editors like VSCode. They inject helpful information… --- ## [Lambda Syntax in Mojo: A Problem That Doesn't Need to Exist](https://forum.modular.com/t/lambda-syntax-in-mojo-a-problem-that-doesnt-need-to-exist/3367)
**Author:** [@Sarctiann](https://forum.modular.com/u/Sarctiann)\ **Replies:** 2\ **Last updated:** [August 3, 2026, 6:36pm UTC](https://forum.modular.com/t/lambda-syntax-in-mojo-a-problem-that-doesnt-need-to-exist/3367 "2026-08-03T18:36:44Z")
The official roadmap lists lambdas as pending, with the blocker being a syntax decision regarding type annotations. I believe this is overthinking it. Lambdas don’t need inline type annotations because their types are a… --- ## [Pointer ops consistent naming](https://forum.modular.com/t/pointer-ops-consistent-naming/3366)
**Author:** [@yinon](https://forum.modular.com/u/yinon)\ **Replies:** 0\ **Last updated:** [August 2, 2026, 12:41pm UTC](https://forum.modular.com/t/pointer-ops-consistent-naming/3366 "2026-08-02T12:41:57Z")
There are currently many different names for pointer operations, some of which are missing. This is a proposed unified naming scheme. deinit existing init copy/move source(val/ptr) count(1/n) current proposed X V… --- ## [Provide an option to require explicit \`var\` declarations](https://forum.modular.com/t/provide-an-option-to-require-explicit-var-declarations/3207)
**Author:** [@christoph\_schlumpf](https://forum.modular.com/u/christoph_schlumpf)\ **Replies:** 24\ **Last updated:** [July 31, 2026, 4:16pm UTC](https://forum.modular.com/t/provide-an-option-to-require-explicit-var-declarations/3207 "2026-07-31T16:16:02Z")
Mojo has two variable declaration styles: “explicit block scoped var declarations” and “implicit function scoped variable declarations” Both styles can be mixed, even inside one function. This can lead to confusion an… --- ## [Calling all AMD RDNA users: help us bring full MAX support to your GPUs!](https://forum.modular.com/t/calling-all-amd-rdna-users-help-us-bring-full-max-support-to-your-gpus/2015)
**Author:** [@BradLarson](https://forum.modular.com/u/BradLarson)\ **Replies:** 18\ **Last updated:** [July 28, 2026, 7:26pm UTC](https://forum.modular.com/t/calling-all-amd-rdna-users-help-us-bring-full-max-support-to-your-gpus/2015 "2026-07-28T19:26:32Z")
Hi everyone :waving\_hand: You might remember that with our 25.4 release, we officially brought full support for AMD’s powerful data center GPUs (MI300X and MI325X) to our MAX and Mojo platforms. These CDNA3-based GPUs a… --- ## [Llm.🔥: GPT-2 training in pure Mojo, with hand-written CUDA and Metal GPU kernels](https://forum.modular.com/t/llm-gpt-2-training-in-pure-mojo-with-hand-written-cuda-and-metal-gpu-kernels/3304)
**Author:** [@ulmentflam](https://forum.modular.com/u/ulmentflam)\ **Replies:** 2\ **Last updated:** [July 12, 2026, 6:46pm UTC](https://forum.modular.com/t/llm-gpt-2-training-in-pure-mojo-with-hand-written-cuda-and-metal-gpu-kernels/3304 "2026-07-12T18:46:03Z")
I ported Andrej Karpathy’s llm.c to Mojo, extending @dorjeduck’s llm.:fire: (written for Mojo 25.5, CPU only) with GPU kernels, in honor of Mojo’s v1.0.0 release. It runs on nightly 1.0.0b3. @dorjeduck showed Mojo could … --- ## [Disabling ASAP destruction within a function](https://forum.modular.com/t/disabling-asap-destruction-within-a-function/3299)
**Author:** [@Ryulord](https://forum.modular.com/u/Ryulord)\ **Replies:** 2\ **Last updated:** [July 6, 2026, 9:01pm UTC](https://forum.modular.com/t/disabling-asap-destruction-within-a-function/3299 "2026-07-06T21:01:28Z")
I recently opened this issue which was closed as “not planned”. The proposed solution was to model origins as part of the type but this isn’t practical for various reasons. One reason is that many structs in Vulkan have… --- ## [What is the realistic roadmap for integrated GPU support on Intel and ARM64 SoCs?](https://forum.modular.com/t/what-is-the-realistic-roadmap-for-integrated-gpu-support-on-intel-and-arm64-socs/3040)
**Author:** [@pauljurczak](https://forum.modular.com/u/pauljurczak)\ **Replies:** 3\ **Last updated:** [July 3, 2026, 9:38pm UTC](https://forum.modular.com/t/what-is-the-realistic-roadmap-for-integrated-gpu-support-on-intel-and-arm64-socs/3040 "2026-07-03T21:38:10Z")
I know that this is not on top of the to-do list at this moment, but it could be a powerful unifying way of developing GPGPU code on embedded systems. Setting aside a wide variety of NPUs present on many modern SoCs, bot… --- ## [Typed Error Best Practices](https://forum.modular.com/t/typed-error-best-practices/3290)
**Author:** [@moseschmiedel](https://forum.modular.com/u/moseschmiedel)\ **Replies:** 1\ **Last updated:** [July 2, 2026, 2:41am UTC](https://forum.modular.com/t/typed-error-best-practices/3290 "2026-07-02T02:41:22Z")
Hi, I was wondering what the current best practices when using typed errors in your codebase. I currently use one error type per module which holds an integer to discriminate between variants. I then have implicit conver… --- ## [Seeking Peer Review: Math Derivations for GPT-2 Backpropagation in llm.mojo](https://forum.modular.com/t/seeking-peer-review-math-derivations-for-gpt-2-backpropagation-in-llm-mojo/3251)
**Author:** [@ulmentflam](https://forum.modular.com/u/ulmentflam)\ **Replies:** 0\ **Last updated:** [June 17, 2026, 8:55pm UTC](https://forum.modular.com/t/seeking-peer-review-math-derivations-for-gpt-2-backpropagation-in-llm-mojo/3251 "2026-06-17T20:55:51Z")
Hi Everyone, In honor of Mojo v1.0.0’s imminent arrival, I am working on implementing backpropagation and autograd for an updated version of llm.mojo, which is a pure-Mojo implementation of GPT-2/3 inspired by Andrej Ka… --- ## [Why Variable Declaration Matters — And How Mojo Can Become Truly Python-Friendly](https://forum.modular.com/t/why-variable-declaration-matters-and-how-mojo-can-become-truly-python-friendly/3246)
**Author:** [@KilianKlaiber](https://forum.modular.com/u/KilianKlaiber)\ **Replies:** 4\ **Last updated:** [June 17, 2026, 6:32am UTC](https://forum.modular.com/t/why-variable-declaration-matters-and-how-mojo-can-become-truly-python-friendly/3246 "2026-06-17T06:32:41Z")
Why Variable Declaration Matters Variable declaration is one of the very first things every programmer learns after print("Hello World"). It forms your first and lasting impression of a language. If declaring variables… [Next page](https://forum.modular.com/tag/discussion/2.md?match_all_tags=true&page=1&tags%5B%5D=discussion)