Downloads · 30 days
27
31% of all-time downloads
Rombos-LLM-V2.5-Qwen-72b-exl2_3.25bpw
async0x42/Rombos-LLM-V2.5-Qwen-72b-exl2_3.25bpw
Rombos-LLM-V2.5-Qwen-72b-exl2_3.25bpw is a text generation model from async0x42. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
All-time downloads
87
Public
Repo size
32 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors32 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- qwen2
- Access
- Public
- Created
- Nov 2, 2024
- Updated
- Nov 2, 2024
- SHA
- 6fe5b6a6
Try a prompt
Base models
Model card
From the Hugging Face model README
Rombos-LLM-V2.5-Qwen-72b
Rombos-LLM-V2.5-Qwen-72b is a continues finetuned version of Qwen2.5-72B. I noticed recently that the Qwen team did not learn from my methods of continuous finetuning, the great benefits, and no downsides of it. So I took it upon myself to merge the instruct model with the base model myself using the Ties merge method
This version of the model shows higher performance than the original instruct and base models.
Quants: (Coming soon)
GGUF: https://huggingface.co/bartowski/Replete-LLM-V2.5-Qwen-72b-GGUF
EXL2:
Benchmarks: (Coming soon)
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 45.39 |
| IFEval (0-Shot) | 71.55 |
| BBH (3-Shot) | 61.27 |
| MATH Lvl 5 (4-Shot) | 47.58 |
| GPQA (0-shot) | 19.80 |
| MuSR (0-shot) | 17.32 |
| MMLU-PRO (5-shot) | 54.83 |
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- other
- Created
- Nov 2, 2024
- Updated
- Nov 2, 2024