A new nightly version has been released! ![]()
See the quickstart guide for installation instructions: Quickstart | Modular
MAX changelog updates:
- Added a
poison-allmode to theMODULAR_DEBUG_DEVICE_ALLOCATORenvironment
variable for debugging uninitialized device-memory reads. Unlike the existing
uninitialized-poison(which fills graph tensors with a type-aware, non-NaN
sentinel and is detected by an instrumented load check),poison-allfills
every memory-manager allocation β including internal scratch and other
non-tensor buffers β with a raw byte (default0xFF, a NaN pattern for
float32/bfloat16), so an uninitialized read propagates NaN into the output
and trips existing differential tests without any kernel instrumentation. The
fill byte is configurable via
MODULAR_DEVICE_CONTEXT_MEMORY_MANAGER_POISON_PATTERN, and the mode composes
without-of-boundsredzone checks. Because the NaN can also surface on
legitimately-uninitialized allocation padding, it is a manual debugging aid
rather than a default. - Added opt-in SHA-256 KV-cache block hashing. A new
kv_cache_hash_algo
field onKVCacheConfig(defaultahash64; opt-insha256and
sha256_64) threads through the pipeline and serve config, selecting a
Mojoblock_hasher_sha256and the matchinghash_request_tokensSHA-256
path. Chat-completion requests also accept an optionalcache_saltfield
that scopes prefix-cache reuse to a single per-request KV chain. Default
behavior is the same as the existingahash64path. - Added
max.experimental.nn.subgraphableforModulesubgraph compilation: a
repeated block (via the@subgraphableclass decorator, or the
subgraphable(layer)(x)call form) lowers to one shared subgraph reused per
call. Opt out per compile withModule.compile(..., allow_subgraphs=False).
Mojo changelog updates:
- [stdlib] Support input dependencies for DeviceGraphBuilder.collect_dependencies
- [lint] Fix or ignore various typos
Raw MAX diff: https://github.com/modular/modular/compare/a80dd6b9e549a2f2ee9d74c581caf2b225caac0a...0f7c9887f2f70a8b9a125a388911442f6f1d6a4c)>
Current Mojo changelog: https://github.com/modular/modular/blob/main/mojo/docs/nightly-changelog.md