Downloads · 30 days
100
0% of all-time downloads
KnutJaegersberg/Qwen-14B-Llamafied
Qwen-14B-Llamafied is a text generation model from KnutJaegersberg. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This is a llamafied qwen-14b for compatibility with the llama software ecosystem.
Downloads · 30 days
100
0% of all-time downloads
All-time downloads
72.6K
Public
Repo size
56.7 GB
Likes
5
Public
Click a slice to open those files.
.bin28.3 GB · 100%
From the Hugging Face model README
This is a llamafied qwen-14b for compatibility with the llama software ecosystem.
I used this script to make the model and used the tokenizer of CausalLM, as suggested in the comments of the script.
https://github.com/hiyouga/LLaMA-Factory/blob/main/tests/llamafy_qwen.py
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 63.09 |
| AI2 Reasoning Challenge (25-Shot) | 55.20 |
| HellaSwag (10-Shot) | 82.31 |
| MMLU (5-Shot) | 66.11 |
| TruthfulQA (0-shot) | 45.60 |
| Winogrande (5-shot) | 76.56 |
| GSM8k (5-shot) | 52.77 |