Iβm proud to announce that Magic now has an exciting new feature called
magic 8ball π±
!
With
magic 8ball
, you can ask any supported MAX model the most profound questions you have ever wanted to know.
magic 8ball
is powered by MAX Pipelines on the backend. Pass in your favorite models and get the answers you so desire.
You can try magic 8ball
now on the magic pre-release channel.
Install
- Install magic if you donβt have it:
curl -sSL https://magic.modular.com/ | bash
- Update to magic to pre-release version 0.7.3 with
magic self-update --prerelease
- Install/update max-pipelines with
magic global install -u max-pipelines
You are ready!
To have magic start max-pipelines for each run:
magic 8ball "Magic eight ball! Will I find true love?"
Pro tip!
For better performance, keep a persisted max-pipelines running with:
max-pipelines --module-path modularai/Llama-3.1-8B-Instruct-GGUF
and then in another terminal, use the -n
or --no-start-server
flag on magic 8ball
to connect to an existing max-pipelines server:
magic 8ball -n "Am I pretty?"
Have fun! Entertainment purposes only.
This is a pre-release beta feature and may be removed in a future release. It may do unexpected things. We are at the mercy of the 8ball.