Downloads · 30 days
202
6% of all-time downloads
typeof/Baguettotron-GGUF
Baguettotron-GGUF is a machine learning model from typeof. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model was converted to GGUF format from PleIAs/Baguettotron using llama.cpp. Refer to the original model card for more details on the model.
Downloads · 30 days
202
6% of all-time downloads
All-time downloads
3.2K
Public
Repo size
4.4 GB
Likes
6
Public
Click a slice to open those files.
.gguf4.4 GB · 100%
From the Hugging Face model README
This model was converted to GGUF format from PleIAs/Baguettotron using llama.cpp.
Refer to the original model card for more details on the model.
Install llama.cpp through brew (works on Mac and Linux)
Invoke the llama.cpp server or the CLI.
llama-cli --hf-repo typeof/Baguettotron-gguf --hf-file Baguettotron-Q4_K_M.gguf -p "The meaning to life and the universe is"
llama-server --hf-repo typeof/Baguettotron-gguf --hf-file Baguettotron-Q4_K_M.gguf -c 2048