Downloads · 30 days
9
3% of all-time downloads
Novaciano/X-3.2-1B-iMatrix-GGUF
X-3.2-1B-iMatrix-GGUF is a machine learning model from Novaciano. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
Model creator: Novaciano<br/ Original model: Novaciano/X-3.2-1B<br/ GGUF quantization: provided by Novaciano using llama.cpp<br/ 🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making…
Downloads · 30 days
9
3% of all-time downloads
All-time downloads
338
Public
Repo size
395 MB
Likes
0
Public
Click a slice to open those files.
.gguf395 MB · 100%
From the Hugging Face model README
Model creator: Novaciano<br/>
Original model: Novaciano/X-3.2-1B<br/>
GGUF quantization: provided by Novaciano using llama.cpp<br/>
🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.
ollama run "hf.co/Novaciano/X-3.2-1B-iMatrix-GGUF:IQ1_S"
lms load "Novaciano/X-3.2-1B-iMatrix-GGUF"
llama-cli --hf "Novaciano/X-3.2-1B-iMatrix-GGUF:IQ1_S" -p "The meaning to life and the universe is"
llama-server --hf "Novaciano/X-3.2-1B-iMatrix-GGUF:IQ1_S" -c 4096