Downloads · 30 days
41
12% of all-time downloads
TheTsar1209/qwen-carpmuscle-v0.2
qwen-carpmuscle-v0.2 is a text generation model from TheTsar1209. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
41
12% of all-time downloads
All-time downloads
353
Public
Parameters
14.8B
29.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors29.5 GB · 100%
From the Hugging Face model README
A Fishy Model
This model was trained on with SFT on the ChatML format with 8k context.
The main difference from v0.1 and v0.2 was that v0.1 was trained on responses only while v0.2 was not.
This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 33.11 |
| IFEval (0-Shot) | 52.57 |
| BBH (3-Shot) | 48.18 |
| MATH Lvl 5 (4-Shot) | 25.00 |
| GPQA (0-shot) | 14.09 |
| MuSR (0-shot) | 12.75 |
| MMLU-PRO (5-shot) | 46.08 |