Downloads · 30 days
3
6% of all-time downloads
sardukar/openbuddy-llama3-8b-v21.1-8k-g128-q4-gemm-awq
openbuddy-llama3-8b-v21.1-8k-g128-q4-gemm-awq is a text generation model from sardukar. Use it when you need the model to write or continue text. It is set up for transformers.
AWQ g128 4-bit version of OpenBuddy/openbuddy-llama3-8b-v21.1-8k
Downloads · 30 days
3
6% of all-time downloads
All-time downloads
54
Public
Parameters
8B
5.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors5.7 GB · 100%
How the weights are stored.
I327B · 87%
From the Hugging Face model README
AWQ g128 4-bit version of OpenBuddy/openbuddy-llama3-8b-v21.1-8k
Check out the original model here