Downloads · 30 days
13
5% of all-time downloads
Meta-Llama-3-8B-Instruct-FP8-v1
comaniac/Meta-Llama-3-8B-Instruct-FP8-v1
Meta-Llama-3-8B-Instruct-FP8-v1 is a text generation model from comaniac. Use it when you need the model to write or continue text. It is set up for transformers.
Weights and activations are per-tensor quantized to float8e4m3. Quantization with AutoFP8. Calibration dataset: Ultrachat (mgoin/ultrachat2k) Samples: 512 Sequence length: 8192
All-time downloads
237
Public
Parameters
8B
9.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors9.1 GB · 100%
Parameter types
How the weights are stored.
F8_E4M37B · 87%
Try a prompt
Model card
From the Hugging Face model README
Llama-3-8B-Instruct-FP8-v1
- Weights and activations are per-tensor quantized to float8_e4m3.
- Quantization with AutoFP8.
- Calibration dataset: Ultrachat (mgoin/ultrachat_2k)
- Samples: 512
- Sequence length: 8192
Evaluation
TBA
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- May 22, 2024
- Updated
- May 24, 2024