A new nightly version has been released! ![]()
See the quickstart guide for installation instructions: Quickstart | Modular
MAX changelog updates:
- Improved scheduling so that we achieve higher KVCache utilization and batch
sizes. Now a CE request is only scheduled if there is at least 5% KVCache memory
free after allocating blocks for that request OR if no active requests exist.
This watermark parameter is controlled by--kvcache-ce-watermark.
Increasing this value has been show to lead to a higher number of preemptions.
Mojo changelog updates:
- [Docs] 25.7 Mojo changelog edits.
- [stdlib] Add
Tuple.concat - [stdlib] Add
debug_asserttoalloc. - [stdlib] Add
Tuple.reverse() - [mojo-lang] Disambiguate … and pass in trait methods
- [stdlib][mojo-lang] Emit compiler warning on unqualified struct parameter access
Raw MAX diff: https://github.com/modular/modular/compare/e8cce25027e913cdb54baf2aedc1789a11aa5301...5226bb020176591d4a5ceed00483637010ebda22)>
Current Mojo changelog: https://github.com/modular/modular/blob/main/mojo/docs/changelog.md