Downloads · 30 days
18
0% of all-time downloads
Codestral-22B-v0.1-FIM-Fix-GPTQ
ArthurGprog/Codestral-22B-v0.1-FIM-Fix-GPTQ
Codestral-22B-v0.1-FIM-Fix-GPTQ is a text generation model from ArthurGprog. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This model is a GPTQ-quantized version of the Codestral-22B-v0.1 model with the FIM fix, designed to provide improved performance and efficiency. The original Codestral-22B-v0.1 model had a tokenization error for the…
All-time downloads
5K
Public
Parameters
22.2B
12.2 GB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors12.2 GB · 100%
Parameter types
How the weights are stored.
I3221.8B · 98%
Try a prompt
Model card
From the Hugging Face model README
This model is a GPTQ-quantized version of the Codestral-22B-v0.1 model with the FIM fix, designed to provide improved performance and efficiency. The original Codestral-22B-v0.1 model had a tokenization error for the FIM use case, which was addressed by the legraphista/Codestral-22B-v0.1-hf-FIM-fix model. This GPTQ-quantized model builds upon the fixed model, using default AutoGPTQ arguments and 4 bits per weight.
Compatible with vllm
Alternative to dan-kwiat/Codestral-22B-v0.1-hf-FIM-fix-awq
Tips for Code Completion
When using this model or any other Codestral-22B-v0.1 model for code completion in VSCode on Windows, make sure to use LF (Line Feed) instead of CRLF (Carriage Return Line Feed) for better results. This will prevent unrelated '\' characters from appearing in completions.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- other
- Created
- Jun 18, 2024
- Updated
- Jul 3, 2024