Downloads · 30 days
31
19% of all-time downloads
simaai/Qwen3-4B-Instruct-2507-GPTQ-Safetensors
Qwen3-4B-Instruct-2507-GPTQ-Safetensors is a text generation model from simaai. Use it when you need the model to write or continue text. The card lists the license as other.
Pre-LLiMa Hugging Face checkpoint for Sima.ai compilation. Source revision was not captured locally; pin an immutable revision before publication.
Downloads · 30 days
31
19% of all-time downloads
All-time downloads
159
Public
Parameters
4.4B
2.8 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors2.8 GB · 99%
How the weights are stored.
I324B · 91%
From the Hugging Face model README
Pre-LLiMa Hugging Face checkpoint for Sima.ai compilation. Source revision was not captured locally; pin an immutable revision before publication.
Linear layers and lm_head: GPTQ, symmetric INT4, group size 256, static actorder.HuggingFaceH4/ultrachat_200k, 512 samples, 1024 tokens, batch size 1.EleutherAI/wikitext_document_level, wikitext-2-raw-v1, full run (2026-07-16).
| Checkpoint | Word perplexity |
|---|---|
Qwen/Qwen3-4B-Instruct-2507 | 14.271144 |
| This GPTQ checkpoint | 15.294486 |
python quantize.py --model-path /project/mlasw/share/huggingface/models--Qwen--Qwen3-4B-Instruct-2507 --output-dir /path/to/output
Included: quantized safetensors, tokenizer/configuration, quantize.py, recipe.yaml, and versions.txt.
Saved scales were checked for finite values. Transformers load/generation smoke test is pending before release. Quantization quality can vary by language, prompt format, domain, and context length; validate the compiled deployment on target hardware.