Downloads · 30 days
409
12% of all-time downloads
bagel-34b-v0.4-iMat.GGUF
dranger003/bagel-34b-v0.4-iMat.GGUF
bagel-34b-v0.4-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin/bagel-34b-v0.4 The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration dat…
All-time downloads
3.3K
Public
Repo size
189 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf98 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- Feb 17, 2024
- Updated
- Jun 27, 2024
- SHA
- 9072bbaa
Try a prompt
Model card
From the Hugging Face model README
GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin/bagel-34b-v0.4
The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration dataset.
Prompt strategies: https://huggingface.co/jondurbin/bagel-34b-v0.4#prompting-strategies
Feb. 21, 2024: Updating quants from latest commit.
| Layers | Context | Template |
|---|---|---|
| <pre>60</pre> | <pre>200000</pre> | <pre>[INST] <<SYS>><br>{instructions}<br><</SYS>><br><br>{prompt} [/INST]<br>{response}</pre> |
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Created
- Feb 17, 2024
- Updated
- Jun 27, 2024