Downloads · 30 days
89
4% of all-time downloads
Llama-3.2-3B-Instruct-abliterated-GGUF
ZeroWw/Llama-3.2-3B-Instruct-abliterated-GGUF
Llama-3.2-3B-Instruct-abliterated-GGUF is a text generation model from ZeroWw. Use it when you need the model to write or continue text. The card lists the license as mit.
My own (ZeroWw) quantizations. output and embed tensors quantized to f16. all other tensors quantized to q5k or q6k.
All-time downloads
2.5K
Public
Repo size
25.6 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf25.6 GB · 100%
At a glance
- Task
- Text Generation
- License
- mit
- Access
- Public
- Created
- Oct 8, 2024
- Updated
- Oct 8, 2024
- SHA
- 6c799e2c
Try a prompt
Model card
From the Hugging Face model README
My own (ZeroWw) quantizations. output and embed tensors quantized to f16. all other tensors quantized to q5_k or q6_k.
Result: both f16.q6 and f16.q5 are smaller than q8_0 standard quantization and they perform as well as the pure f16.
Updated on: Tue Oct 08, 21:43:50
- Task
- Text Generation
- License
- mit
- Languages
- en
- Created
- Oct 8, 2024
- Updated
- Oct 8, 2024