Downloads · 30 days
200
12% of all-time downloads
LLaMA-65B-4bit-128g
Neko-Institute-of-Science/LLaMA-65B-4bit-128g
LLaMA-65B-4bit-128g is a text generation model from Neko-Institute-of-Science. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
1.6K
Public
Repo size
34.7 GB
Likes
16
Public
Repo makeup
Click a slice to open those files.
.safetensors34.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Apr 7, 2023
- Updated
- Apr 15, 2023
- SHA
- 1cd7f045
Try a prompt
Model card
From the Hugging Face model README
65B (act-order true-sequential groupsize)
wikitext2 3.5319948196411133 (stock 16bit)
wikitext2 3.610668182373047 (32g)
wikitext2 3.650667667388916 (16g)
wikitext2 3.6660284996032715 (128)
ptb-new 7.66942024230957 (stock 16bit)
ptb-new 7.71506929397583 (32g)
ptb-new 7.762592792510986 (128)
ptb-new 7.829207897186279 (16g)
c4-new 5.8114824295043945 (stock 16bit)
c4-new 5.859227657318115 (32g)
c4-new 5.893154144287109 (128)
c4-new 5.929086208343506 (16g)
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Apr 7, 2023
- Updated
- Apr 15, 2023