Downloads · 30 days
61
5% of all-time downloads
UNA-SimpleSmaug-34b-v1beta-iMat.GGUF
dranger003/UNA-SimpleSmaug-34b-v1beta-iMat.GGUF
UNA-SimpleSmaug-34b-v1beta-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
<uNOTE</u: You will need a recent build of llama.cpp to run these quants (i.e. at least commit 494c870).
All-time downloads
1.1K
Public
Repo size
106 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf106 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- Mar 7, 2024
- Updated
- Mar 7, 2024
- SHA
- 9b5b6c0f
Try a prompt
Base models
Model card
From the Hugging Face model README
<u>NOTE</u>: You will need a recent build of llama.cpp to run these quants (i.e. at least commit 494c870).
GGUF importance matrix (imatrix) quants for https://huggingface.co/fblgit/UNA-SimpleSmaug-34b-v1beta
- The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration dataset.
- The imatrix is being used on the K-quants as well.
| Layers | Context | Template |
|---|---|---|
| <pre>60</pre> | <pre>32768</pre> | <pre><|startoftext|>[INST] <<SYS>><br>{instructions}<br><</SYS>><br><br>{prompt} [INST]</pre> |
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Created
- Mar 7, 2024
- Updated
- Mar 7, 2024