Downloads · 30 days
58
0% of all-time downloads
Qwen-72B-Llama
Weyaxi/Qwen-72B-Llama
Qwen-72B-Llama is a text generation model from Weyaxi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This is the 🦙 llamafied version of Qwen/Qwen-72B.
All-time downloads
12.7K
Public
Parameters
72.3B
145 GB on disk
Likes
12
Public
Repo makeup
Click a slice to open those files.
.safetensors145 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Jan 30, 2024
- Updated
- Feb 2, 2024
- SHA
- a7fc8b73
Try a prompt
Model card
From the Hugging Face model README
🦙 Qwen-72B-Llama
This is the 🦙 llamafied version of Qwen/Qwen-72B.
🛠️ Reproduction
I used this script to convert the weights:
LLaMA-Factory/tests/llamafy_qwen.py
🔠 Tokenizer
After I converted the weights, I took the tokenizer from KnutJaegersberg/Qwen-14B-Llamafied and uploaded it to this repository.
📊 Eval Scores Compared to Original Model
Here are some of the evaluation score comparisons based on the Open LLM Leaderboard.
| Metric | Qwen-72B | Qwen-72B-Llama |
|---|---|---|
| Avg. | 73.6 | 69.53 |
| ARC (25-shot) | 65.19 | 64.85 |
| HellaSwag (10-shot) | 85.94 | 83.27 |
| MMLU (5-shot) | 77.37 | 73.66 |
| TruthfulQA (0-shot) | 60.19 | 57.6 |
| Winogrande (5-shot) | 82.48 | 81.53 |
| GSM8K (5-shot) | 70.43 | 56.25 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Created
- Jan 30, 2024
- Updated
- Feb 2, 2024