Downloads · 30 days
561
4% of all-time downloads
mgoin/Qwen3-0.6B-MXFP8
Qwen3-0.6B-MXFP8 is a machine learning model from mgoin. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
561
4% of all-time downloads
All-time downloads
12.9K
Public
Parameters
610M
777 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors766 MB · 98%
How the weights are stored.
F8_E4M3440M · 72%
From the Hugging Face model README
vllm serve mgoin/Qwen3-0.6B-MXFP8
python tests/evals/gsm8k/gsm8k_eval.py
Running GSM8K evaluation: 1319 questions, 5-shot
Evaluating: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1319/1319 [00:04<00:00, 305.10it/s]
Results:
Accuracy: 0.389
Invalid responses: 0.001
Total latency: 4.336 s
Questions per second: 304.229
Total output tokens: 130948
Output tokens per second: 30203.298