Downloads · 30 days
249
10% of all-time downloads
CodeFuse-DeepSeek-33B-iMat.GGUF
dranger003/CodeFuse-DeepSeek-33B-iMat.GGUF
CodeFuse-DeepSeek-33B-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
GGUF importance matrix (imatrix) quants for https://huggingface.co/codefuse-ai/CodeFuse-DeepSeek-33B The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibr…
All-time downloads
2.5K
Public
Repo size
109 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf109 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- other
- Access
- Public
- Created
- Mar 3, 2024
- Updated
- Mar 3, 2024
- SHA
- e1d57c6d
Try a prompt
Model card
From the Hugging Face model README
GGUF importance matrix (imatrix) quants for https://huggingface.co/codefuse-ai/CodeFuse-DeepSeek-33B
- The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration dataset.
- The imatrix is being used on the K-quants as well.
| Layers | Context | Template |
|---|---|---|
| <pre>62</pre> | <pre>16384</pre> | <pre><s>system<br>{instructions}<br><s>human<br>{prompt}<br><s>bot<br>{response}<｜end▁of▁sentence｜></pre> |
- Task
- Text Generation
- Library
- gguf
- License
- other
- Created
- Mar 3, 2024
- Updated
- Mar 3, 2024