Downloads · 30 days
0
mohameddalii/qwen25-7b-saudi-gptq
qwen25-7b-saudi-gptq is a machine learning model from mohameddalii. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for hermes. The card lists the license as apache-2.0.
Fine-tuned from Qwen/Qwen2.5-7B-Instruct on Saudi Najdi dialect conversations.
Downloads · 30 days
0
Access
Public
Updated Mar 19, 2026
Parameters
7.6B
5.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors5.6 GB · 100%
How the weights are stored.
I326.5B · 86%
From the Hugging Face model README
Fine-tuned from Qwen/Qwen2.5-7B-Instruct on Saudi Najdi dialect conversations.
python -m vllm.entrypoints.openai.api_server \
--model mohameddalii/qwen25-7b-saudi-gptq \
--served-model-name qwen-saudi \
--tool-call-parser hermes \
--enable-auto-tool-choice \
--quantization gptq \
\
--max-model-len 4096 \
--dtype float16 \
--gpu-memory-utilization 0.88 \
--host 0.0.0.0 --port 8000
| Parameter | Value |
|---|---|
| Base model | Qwen/Qwen2.5-7B-Instruct |
| Method | QLoRA 4-bit NF4 |
| LoRA r | 64 |
| LoRA alpha | 128 |
| Context | 4096 tokens |
| Dataset | HeshamHaroon/saudi-dialect-conversations |
| GPUs | 2× RTX 4090 (DDP) |
This model uses GPTQ quantization (exllamav2 kernels) which supports V100 (sm_70). AWQ is NOT used as it requires sm_80+.