Downloads · 30 days
123
17% of all-time downloads
stelterlab/Yi-Coder-9B-Chat-AWQ
Yi-Coder-9B-Chat-AWQ is a text generation model from stelterlab. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Model creator: 01-ai<br Original model: Yi-Coder-9B-Chat<br AWQ quantization: done by stelterlab in INT4 GEMM with AutoAWQ by casper-hansen (https://github.com/casper-hansen/AutoAWQ/)<br
Downloads · 30 days
123
17% of all-time downloads
All-time downloads
724
Public
Parameters
8.8B
10.2 GB on disk
Likes
3
Public
Click a slice to open those files.
.safetensors5.4 GB · 100%
How the weights are stored.
I328.3B · 94%
From the Hugging Face model README
Model creator: 01-ai<br> Original model: Yi-Coder-9B-Chat<br> AWQ quantization: done by stelterlab in INT4 GEMM with AutoAWQ by casper-hansen (https://github.com/casper-hansen/AutoAWQ/)<br>
Yi Coder 9B Chat is a new coding model from Yi, supporting a staggering 52 programming language, and featuring a max context length of 128k, making it great for ingesting large codebases.<br>This model is tuned for chatting, not auto completion, so should be chatted with for programming questions.<br>It is the first model under 10B parameters to pass 20% on LiveCodeBench.
Trained on an extensive set of languages:
128k context length, achieves 23% pass rate on LiveCodeBench, surpassing even some SOTA 15-33B models.
For more information see original model card Yi-Coder-9B-Chat