Downloads · 30 days
83
9% of all-time downloads
ig1/Qwen2.5-72B-Instruct-FP8-Dynamic
Qwen2.5-72B-Instruct-FP8-Dynamic is a text generation model from ig1. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
FP8 activation quantization performed with llm-compressor
Downloads · 30 days
83
9% of all-time downloads
All-time downloads
970
Public
Parameters
72.7B
75.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors75.2 GB · 100%
How the weights are stored.
F8_E4M370.2B · 97%
From the Hugging Face model README
FP8 activation quantization performed with llm-compressor