Downloads · 30 days
52
2% of all-time downloads
labradorite-13b-iMat.GGUF
dranger003/labradorite-13b-iMat.GGUF
labradorite-13b-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
<uNOTE</u: You will need a recent build of llama.cpp to run these quants (i.e. at least commit 494c870).
All-time downloads
2.3K
Public
Repo size
70.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf70.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- Mar 9, 2024
- Updated
- Mar 9, 2024
- SHA
- bdcd532c
Try a prompt
Base models
Model card
From the Hugging Face model README
<u>NOTE</u>: You will need a recent build of llama.cpp to run these quants (i.e. at least commit 494c870).
GGUF importance matrix (imatrix) quants for https://huggingface.co/ibm/labradorite-13b
- The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration dataset.
- The imatrix is being used on the K-quants as well.
| Layers | Context | Template |
|---|---|---|
| <pre>40</pre> | <pre>4096</pre> | <pre><|system|><br>{sys_prompt}<br><|user|><br>{inputs}<br><|assistant|><br>{response}<|endoftext|></pre> |
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Created
- Mar 9, 2024
- Updated
- Mar 9, 2024