Downloads · 30 days
576
15% of all-time downloads
okenk/Huihui-Spark-X2.5-4B-abliterated-GGUF
Huihui-Spark-X2.5-4B-abliterated-GGUF is a machine learning model from okenk. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Run using llama-cli as I used llama-cpp to convert to GGUF and Quantize it into 4-bit llama-cli -m spark-Q4KM.gguf -c 4096 -sys "You are a helpful assistant. Always respond in the same language as the user."
Downloads · 30 days
576
15% of all-time downloads
All-time downloads
3.9K
Public
Repo size
10.8 GB
Likes
5
Public
Click a slice to open those files.
.gguf10.8 GB · 100%
From the Hugging Face model README
Run using llama-cli as I used llama-cpp to convert to GGUF and Quantize it into 4-bit
llama-cli -m spark-Q4_K_M.gguf -c 4096 -sys "You are a helpful assistant. Always respond in the same language as the user."