Downloads · 30 days
15
1% of all-time downloads
LLaMA-7B-4bit-128g
Neko-Institute-of-Science/LLaMA-7B-4bit-128g
LLaMA-7B-4bit-128g is a text generation model from Neko-Institute-of-Science. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
2.5K
Public
Repo size
3.9 GB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.safetensors3.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Apr 7, 2023
- Updated
- Apr 15, 2023
- SHA
- 0bb5d09a
Try a prompt
Model card
From the Hugging Face model README
7B (act-order true-sequential groupsize)
wikitext2 5.677095890045166 (stock 16bit)
wikitext2 5.768329620361328 (32g)
wikitext2 5.833956718444824 (128g)
ptb-new 10.10704231262207 (stock 16bit)
ptb-new 10.273148536682129 (32g)
ptb-new 10.347890853881836 (128g)
c4-new 7.343583106994629 (stock 16bit)
c4-new 7.443920612335205 (32g)
c4-new 7.5146918296813965 (128g)
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Apr 7, 2023
- Updated
- Apr 15, 2023