Downloads · 30 days
53
21% of all-time downloads
OpenCodeInterpreter-CL-70B-iMat.GGUF
dranger003/OpenCodeInterpreter-CL-70B-iMat.GGUF
OpenCodeInterpreter-CL-70B-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as llama2.
<uNOTE</u: You will need a recent build of llama.cpp to run these quants (i.e. at least commit 494c870).
All-time downloads
248
Public
Repo size
83.2 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf83.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- llama2
- Access
- Public
- Created
- Mar 5, 2024
- Updated
- Mar 5, 2024
- SHA
- ada37cf1
Try a prompt
Model card
From the Hugging Face model README
<u>NOTE</u>: You will need a recent build of llama.cpp to run these quants (i.e. at least commit 494c870).
GGUF importance matrix (imatrix) quants for https://huggingface.co/m-a-p/OpenCodeInterpreter-CL-70B
- The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration dataset.
- The imatrix is being used on the K-quants as well.
OpenCodeInterpreter is a family of open-source code generation systems designed to bridge the gap between large language models and advanced proprietary systems like the GPT-4 Code Interpreter. It significantly advances code generation capabilities by integrating execution and iterative refinement functionalities. This model is based on CodeLlama-70b-Python-hf.
| Layers | Context | Template |
|---|---|---|
| <pre>80</pre> | <pre>16384</pre> | <pre><s>[INST] {prompt} [/INST]</pre> |
- Task
- Text Generation
- Library
- gguf
- License
- llama2
- Created
- Mar 5, 2024
- Updated
- Mar 5, 2024