Downloads · 30 days
29
25% of all-time downloads
Rombos-LLM-V2.5-Qwen-72b-exl2_3.75bpw
async0x42/Rombos-LLM-V2.5-Qwen-72b-exl2_3.75bpw
Rombos-LLM-V2.5-Qwen-72b-exl2_3.75bpw is a text generation model from async0x42. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
All-time downloads
118
Public
Repo size
36.4 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors36.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- qwen2
- Access
- Public
- Created
- Nov 2, 2024
- Updated
- Nov 2, 2024
- SHA
- e0400664
Try a prompt
Base models
Model card
From the Hugging Face model README
Rombos-LLM-V2.5-Qwen-72b
Rombos-LLM-V2.5-Qwen-72b is a continues finetuned version of Qwen2.5-72B. I noticed recently that the Qwen team did not learn from my methods of continuous finetuning, the great benefits, and no downsides of it. So I took it upon myself to merge the instruct model with the base model myself using the Ties merge method
This version of the model shows higher performance than the original instruct and base models.
Quants: (Coming soon)
GGUF: https://huggingface.co/bartowski/Replete-LLM-V2.5-Qwen-72b-GGUF
EXL2:
Benchmarks: (Coming soon)
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 45.39 |
| IFEval (0-Shot) | 71.55 |
| BBH (3-Shot) | 61.27 |
| MATH Lvl 5 (4-Shot) | 47.58 |
| GPQA (0-shot) | 19.80 |
| MuSR (0-shot) | 17.32 |
| MMLU-PRO (5-shot) | 54.83 |
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- other
- Created
- Nov 2, 2024
- Updated
- Nov 2, 2024