Downloads · 30 days
14
4% of all-time downloads
Mixtral-8x7B-Instruct-v0.1-FP8-v3
comaniac/Mixtral-8x7B-Instruct-v0.1-FP8-v3
Mixtral-8x7B-Instruct-v0.1-FP8-v3 is a text generation model from comaniac. Use it when you need the model to write or continue text. It is set up for transformers.
Weights and activations are per-tensor quantized to float8e4m3. Quantization with AutoFP8 with updated activation scaling factor names. Calibration dataset: Ultrachat-200k Samples: 4096 Sequence length: 8192
All-time downloads
326
Public
Parameters
46.7B
47 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors47 GB · 100%
Parameter types
How the weights are stored.
F8_E4M346.4B · 99%
Try a prompt
Model card
From the Hugging Face model README
Mixtral-8x7B-Instruct-v0.1-FP8-v3
- Weights and activations are per-tensor quantized to float8_e4m3.
- Quantization with AutoFP8 with updated activation scaling factor names.
- Calibration dataset: Ultrachat-200k
- Samples: 4096
- Sequence length: 8192
Evaluation
TBA
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- Created
- Jun 10, 2024
- Updated
- Jun 10, 2024