Downloads · 30 days
10
18% of all-time downloads
mistral-7b-instruct-konkani-awq
konkani/mistral-7b-instruct-konkani-awq
mistral-7b-instruct-konkani-awq is a text generation model from konkani. Use it when you need the model to write or continue text. It is set up for transformers.
This is the merged Konkani LoRA adapter quantized to 4-bit AWQ.
All-time downloads
57
Public
Parameters
7.2B
4.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.2 GB · 100%
Parameter types
How the weights are stored.
I327B · 96%
Try a prompt
Base models
Model card
From the Hugging Face model README
Mistral-7B-Instruct Konkani AWQ
This is the merged Konkani LoRA adapter quantized to 4-bit AWQ.
Source adapter: konkani/mistral-7b-instruct-konkani-lora
Quantization config:
{"zero_point": true, "q_group_size": 128, "w_bit": 4, "version": "GEMM"}
For vLLM, serve this checkpoint directly with --quantization awq.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- Created
- Jul 8, 2026
- Updated
- Jul 8, 2026