Downloads · 30 days
7
12% of all-time downloads
RyanLucas3/ptq-meta-llama_Meta-Llama-3-8B-W4A4-lf10-seed1
ptq-meta-llama_Meta-Llama-3-8B-W4A4-lf10-seed1 is a text generation model from RyanLucas3. Use it when you need the model to write or continue text. It is set up for transformers.
Selected as best per-scheme using fakequantwt103ppl (lower is better).
Downloads · 30 days
7
12% of all-time downloads
All-time downloads
57
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
Selected as best per-scheme using fakequant_wt103_ppl (lower is better).
| split | dense ppl | fakequant ppl |
|---|---|---|
| wikitext-103 test | 25.160288 | 200.317650 |
| lambada validation | 52.215547 | 245.691140 |