Downloads · 30 days
5
9% of all-time downloads
llama3-8b_a6000_nfl_b3g128_bf16_wikitext
radi-cho/llama3-8b_a6000_nfl_b3g128_bf16_wikitext
llama3-8b_a6000_nfl_b3g128_bf16_wikitext is a text generation model from radi-cho. Use it when you need the model to write or continue text. It is set up for transformers.
This is a flute package of LLaMA-3-8B with learned NormalFloat (nfl) quantization. - Bits: 3 - Group: 128 - Precision (scales): bfloat16 - Trainset: 128 samples, WikiText
All-time downloads
56
Public
Parameters
2.4B
4.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.8 GB · 100%
Parameter types
How the weights are stored.
I161.3B · 54%
Try a prompt
Model card
From the Hugging Face model README
This is a flute package of LLaMA-3-8B with learned NormalFloat (nfl) quantization.
- Bits: 3
- Group: 128
- Precision (scales):
bfloat16 - Trainset: 128 samples, WikiText
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Jul 8, 2024
- Updated
- Jul 13, 2024