Downloads · 30 days
14
2% of all-time downloads
LLaMA-13B-4bit-32g
Neko-Institute-of-Science/LLaMA-13B-4bit-32g
LLaMA-13B-4bit-32g is a text generation model from Neko-Institute-of-Science. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
574
Public
Repo size
8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Apr 7, 2023
- Updated
- Apr 15, 2023
- SHA
- 5295d426
Try a prompt
Model card
From the Hugging Face model README
13B (act-order true-sequential groupsize)
wikitext2 5.0906524658203125 (stock 16bit)
wikitext2 5.153766632080078 (32g)
wikitext2 5.198880672454834 (128)
wikitext2 5.266944408416748 (128 no-act)
wikitext2 5.271687984466553 (128 no-t no-act)
ptb-new 9.080504417419434 (stock 16bit)
ptb-new 9.149489402770996 (32g)
ptb-new 9.268823623657227 (128)
ptb-new 9.45678424835205 (128 no-act)
ptb-new 9.497363090515137 (128 no-t no-act)
c4-new 6.798543930053711 (stock 16bit)
c4-new 6.866276264190674 (32g)
c4-new 6.910022735595703 (128)
c4-new 6.955390930175781 (128 no-act)
c4-new 6.956299781799316 (128 no-t no-act)
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Apr 7, 2023
- Updated
- Apr 15, 2023