Downloads · 30 days
21
36% of all-time downloads
DeepMagiCoder-6.7B-DS-Base-AWQ
SebastianBodza/DeepMagiCoder-6.7B-DS-Base-AWQ
DeepMagiCoder-6.7B-DS-Base-AWQ is a text generation model from SebastianBodza. Use it when you need the model to write or continue text. It is set up for transformers.
Quantized version of: https://huggingface.co/SebastianBodza/DeepMagiCoder-6.7B-DS-Base
All-time downloads
59
Public
Parameters
6.7B
3.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.9 GB · 100%
Parameter types
How the weights are stored.
I326.5B · 96%
Try a prompt
Model card
From the Hugging Face model README
Quantized version of: https://huggingface.co/SebastianBodza/DeepMagiCoder-6.7B-DS-Base
Used the Deepseek Template and the Evol-Instruct Code dataset for quantization:
You are an AI programming assistant, utilizing the Deepseek Coder model, developed by Deepseek Company, and you only answer questions related to computer science. For politically sensitive questions, security and privacy issues, and other non-computer science questions, you will refuse to answer.
### Instruction:
{prompt}
### Response:
{response}
Humaneval: {'pass@1': 0.7195121951219512}
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Jan 21, 2024
- Updated
- Jan 22, 2024