Downloads · 30 days
16
0% of all-time downloads
Vikhr-Nemo-12B-Instruct-R-21-09-24-4Bit-GPTQ
qilowoq/Vikhr-Nemo-12B-Instruct-R-21-09-24-4Bit-GPTQ
Vikhr-Nemo-12B-Instruct-R-21-09-24-4Bit-GPTQ is a text generation model from qilowoq. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
- Original Model: Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24
All-time downloads
27.9K
Public
Parameters
2.8B
8.4 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors8.4 GB · 100%
Parameter types
How the weights are stored.
F161.4B · 51%
Try a prompt
Base models
Model card
From the Hugging Face model README
Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24-4Bit-GPTQ
- Original Model: Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24
Quantization
- This model was quantized with the Auto-GPTQ library and dataset containing english and russian wikipedia articles. It has lower perplexity on russian data then other GPTQ models.
- Task
- Text Generation
- Type
- mistral
- License
- apache-2.0
- Languages
- en, ru
- Created
- Sep 29, 2024
- Updated
- Sep 29, 2024