Downloads · 30 days
179
4% of all-time downloads
dranger003/bagel-dpo-20b-v04-llama-iMat.GGUF
bagel-dpo-20b-v04-llama-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin/bagel-dpo-20b-v04-llama The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
Downloads · 30 days
179
4% of all-time downloads
All-time downloads
5K
Public
Repo size
102 GB
Likes
4
Public
Click a slice to open those files.
.gguf102 GB · 100%
From the Hugging Face model README
GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin/bagel-dpo-20b-v04-llama
The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
| Layers | Context | Template |
|---|---|---|
| <pre>48</pre> | <pre>32768</pre> | <pre>[INST] <<SYS>><br>{instructions}<br><</SYS>><br><br>{prompt} [/INST]<br>{response}</pre> |