Downloads · 30 days
185
3% of all-time downloads
dranger003/openbuddy-qwen1.5-14b-v20.1-32k-iMat.GGUF
openbuddy-qwen1.5-14b-v20.1-32k-iMat.GGUF is a machine learning model from dranger003. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
GGUF importance matrix (imatrix) quants for https://huggingface.co/OpenBuddy/openbuddy-qwen1.5-14b-v20.1-32k The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw. The imat…
Downloads · 30 days
185
3% of all-time downloads
All-time downloads
6.5K
Public
Repo size
103 GB
Likes
3
Public
Click a slice to open those files.
.gguf103 GB · 100%
From the Hugging Face model README
| Layers | Context | Template |
|---|---|---|
| <pre>40</pre> | <pre>32768</pre> | <pre><|im_start|>user<br>{prompt}<|im_end|><br><|im_start|>assistant<br>{response}</pre> |