Downloads · 30 days
152
9% of all-time downloads
OpenCodeInterpreter-DS-33B-iMat.GGUF
dranger003/OpenCodeInterpreter-DS-33B-iMat.GGUF
OpenCodeInterpreter-DS-33B-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
<uNOTE</u: You will need a recent build of llama.cpp to run these quants (i.e. at least commit 494c870).
All-time downloads
1.6K
Public
Repo size
129 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf129 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- other
- Access
- Public
- Created
- Mar 5, 2024
- Updated
- Mar 5, 2024
- SHA
- 5294d370
Try a prompt
Model card
From the Hugging Face model README
<u>NOTE</u>: You will need a recent build of llama.cpp to run these quants (i.e. at least commit 494c870).
GGUF importance matrix (imatrix) quants for https://huggingface.co/m-a-p/OpenCodeInterpreter-DS-33B
- The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration dataset.
- The imatrix is being used on the K-quants as well.
OpenCodeInterpreter is a family of open-source code generation systems designed to bridge the gap between large language models and advanced proprietary systems like the GPT-4 Code Interpreter. It significantly advances code generation capabilities by integrating execution and iterative refinement functionalities. This model is based on deepseek-coder-33b-base.
| Layers | Context | Template |
|---|---|---|
| <pre>62</pre> | <pre>16384</pre> | <pre><｜begin▁of▁sentence｜>[INST] <<SYS>><br>{instructions}<br><</SYS>><br><br>{prompt} [/INST]</pre> |
- Task
- Text Generation
- Library
- gguf
- License
- other
- Created
- Mar 5, 2024
- Updated
- Mar 5, 2024