Downloads · 30 days
11
15% of all-time downloads
boboliu/Qwen2-7B-Instruct-FP8-CN
Qwen2-7B-Instruct-FP8-CN is a text generation model from boboliu. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
使用 larryvrh/belleresampled78KCN 校准静态量化的 Qwen/Qwen2-7B-Instruct 模型。
Downloads · 30 days
11
15% of all-time downloads
All-time downloads
75
Public
Parameters
7.6B
8.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors8.7 GB · 100%
How the weights are stored.
F8_E4M36.5B · 86%
From the Hugging Face model README
使用 larryvrh/belle_resampled_78K_CN 校准静态量化的 Qwen/Qwen2-7B-Instruct 模型。
主要为中文通常语言逻辑任务,为 vLLM 准备。
使用 lm-evaluation-harness + vLLM 进行评估:
| 项目 | Qwen2-7B-Instruct | 此项目 | Recovery |
|---|---|---|---|
| ceval-valid | 81.87 | 81.65 | 99.73% |
| cmmlu | 81.78 | 81.26 | 99.36% |
| agieval_logiqa_zh (5 shots) | 47.63 | 48.54 | 101.91% |
| 平均 | 70.43 | 70.48 | 100.07% |