[Hackathon] Experiment: CUDA Kernel → Mojo in Bitnet

currybab · June 29, 2025, 2:40pm

github.com/currybab/modular-hack-weekend-2506

README.md

main

# "Weekend Experiment🧪: CUDA Kernel → Mojo 🔥"

> **Spoiler alert**: Got it working for some cases, but hit some walls too (probably because I'm a GPU newbie trying to learn Mojo at the same time) 😅

## 🤔 What's this about?

I was browsing GitHub and stumbled upon [Microsoft's BitNet repo](https://github.com/microsoft/BitNet). Cool 1-bit neural networks, right? But then I noticed they had this hand-optimized CUDA kernel for `bitlinear_int8xint2` operations. 

Being the curious developer I am, I thought...

**"Hmm, I wonder if I could rewrite just this CUDA kernel in Mojo?"** 

So I grabbed that specific kernel and spent my weekend trying to make Mojo do the same thing.

*(Okay, full confession: I initially thought "How hard can it be? Maybe I can rewrite the whole thing!" But after diving in... let's just say I got humbled real quick 😅)*

Turns out, just this one gnarly GPU kernel was plenty challenging!

**The target**: [This specific CUDA kernel](https://github.com/microsoft/BitNet/tree/main/gpu/bitnet_kernels) (about 120 lines of highly optimized CUDA)

This file has been truncated. show original

system · December 27, 2025, 4:51pm

This topic was automatically closed 180 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
I’m a Mojo newbie... So I decided to Rewrite Unsloth’s NF4 Kernel To Validate Modular's Mission Performance	4	414	December 23, 2025
Modular: Modular GPU Kernel Hackathon Highlights: Innovation, Community, & Mojo🔥 Content blog	0	70	May 20, 2025
Triton_lite, a Triton clone in Mojo: Jeff Niu at the Modular GPU Kernel Hackathon Content youtube	0	48	May 14, 2025
Mojo Q3 Roadmap Update Official Announcements	2	1560	July 20, 2025
My first rasterized image from 3D Gaussians in Mojo (called as PyTorch customOp) Community Showcase	4	319	March 1, 2026

[Hackathon] Experiment: CUDA Kernel → Mojo in Bitnet

Related topics