Downloads · 30 days
26
30% of all-time downloads
Rombos-LLM-V2.5-Qwen-72b-exl2_3.5bpw
async0x42/Rombos-LLM-V2.5-Qwen-72b-exl2_3.5bpw
Rombos-LLM-V2.5-Qwen-72b-exl2_3.5bpw is a text generation model from async0x42. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
All-time downloads
87
Public
Repo size
34.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors34.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- qwen2
- Access
- Public
- Created
- Nov 2, 2024
- Updated
- Nov 2, 2024
- SHA
- be880017
Try a prompt
Base models
Model card
From the Hugging Face model README
Rombos-LLM-V2.5-Qwen-72b
Rombos-LLM-V2.5-Qwen-72b is a continues finetuned version of Qwen2.5-72B. I noticed recently that the Qwen team did not learn from my methods of continuous finetuning, the great benefits, and no downsides of it. So I took it upon myself to merge the instruct model with the base model myself using the Ties merge method
This version of the model shows higher performance than the original instruct and base models.
Quants: (Coming soon)
GGUF: https://huggingface.co/bartowski/Replete-LLM-V2.5-Qwen-72b-GGUF
EXL2:
Benchmarks: (Coming soon)
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 45.39 |
| IFEval (0-Shot) | 71.55 |
| BBH (3-Shot) | 61.27 |
| MATH Lvl 5 (4-Shot) | 47.58 |
| GPQA (0-shot) | 19.80 |
| MuSR (0-shot) | 17.32 |
| MMLU-PRO (5-shot) | 54.83 |
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- other
- Created
- Nov 2, 2024
- Updated
- Nov 2, 2024