Downloads · 30 days
22
14% of all-time downloads
simaai/Llama-2-7B-chat-hf-GPTQ-Safetensors
Llama-2-7B-chat-hf-GPTQ-Safetensors is a text generation model from simaai. Use it when you need the model to write or continue text. The card lists the license as other.
Pre-LLiMa Hugging Face checkpoint for Sima.ai compilation.
Downloads · 30 days
22
14% of all-time downloads
All-time downloads
155
Public
Parameters
6.7B
3.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.6 GB · 100%
How the weights are stored.
I326.6B · 98%
From the Hugging Face model README
Pre-LLiMa Hugging Face checkpoint for Sima.ai compilation.
Linear layers and lm_head: GPTQ, symmetric INT4, group size 256, static actorder.HuggingFaceH4/ultrachat_200k, 512 samples, 1024 tokens, batch size 1.EleutherAI/wikitext_document_level, wikitext-2-raw-v1, full matched run (2026-07-16).
| Checkpoint | Word perplexity |
|---|---|
meta-llama/Llama-2-7b-chat-hf | 12.173323 |
| This GPTQ checkpoint | 12.865505 |
python quantize.py --model-path /project/mlasw/share/huggingface/models--meta-llama--Llama-2-7b-chat-hf --output-dir /path/to/output
Saved scales were checked for finite values. Transformers load/generation smoke test is pending before release. Quantization quality can vary by language, prompt format, domain, and context length; validate the compiled deployment on target hardware.