Downloads · 30 days
509
9% of all-time downloads
deepseek-coder-33b-instruct-iMat.GGUF
dranger003/deepseek-coder-33b-instruct-iMat.GGUF
deepseek-coder-33b-instruct-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
GGUF importance matrix (imatrix) quants for https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
All-time downloads
5.5K
Public
Repo size
89.2 GB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.gguf82 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- other
- Access
- Public
- Created
- Feb 18, 2024
- Updated
- Mar 15, 2024
- SHA
- b03b75da
Try a prompt
Model card
From the Hugging Face model README
GGUF importance matrix (imatrix) quants for https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct
The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
2024-03-13: Updated IQ1_S using latest commit 19885d20. More info here and here.
| Layers | Context | Template |
|---|---|---|
| <pre>62</pre> | <pre>16384</pre> | <pre>{instructions}<br>### Instruction:<br>{prompt}<br>### Response:<br>{response}</pre> |
- Task
- Text Generation
- Library
- gguf
- License
- other
- Created
- Feb 18, 2024
- Updated
- Mar 15, 2024