Downloads · 30 days
10
13% of all-time downloads
Qwen2-7b-Instruct-paraph
yuyijiong/Qwen2-7b-Instruct-paraph
Qwen2-7b-Instruct-paraph is a text generation model from yuyijiong. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Qwen2-7B-Instruct模型在 Long-Instruction-with-Paraphrasing数据集上微调 1 epoch，提升了 long-context 能力
All-time downloads
80
Public
Parameters
7.6B
15.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors15.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Jun 27, 2024
- Updated
- Jun 28, 2024
- SHA
- a245ba8f
Model card
From the Hugging Face model README
Qwen2-7B-Instruct模型在 Long-Instruction-with-Paraphrasing数据集上微调 1 epoch，提升了 long-context 能力
Eval on LongBench
long-context 能力得到提升
| dataset | Qwen2-7B-Instruct | Qwen2-7b-Instruct-paraph |
|---|---|---|
| hotpotqa | 42.79 | 49.46 |
| dureader | 24.28 | 33.94 |
| multifieldqa_en | 46.17 | 49.65 |
| multifieldqa_zh | 60.64 | 64.53 |
| passage_retrieval_en | 70.0 | 84.5 |
| passage_retrieval_zh | 56.0 | 70.0 |
| trec | 76.5 | 76.5 |
| lsht | 43.5 | 45.0 |
| Average | 52.48 | 59.20 |
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Languages
- zh, en
- Created
- Jun 27, 2024
- Updated
- Jun 28, 2024