Downloads · 30 days
70
0% of all-time downloads
Rombos-LLM-V2.5-Qwen-72b
rombodawg/Rombos-LLM-V2.5-Qwen-72b
Rombos-LLM-V2.5-Qwen-72b is a text generation model from rombodawg. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
All-time downloads
19.2K
Public
Parameters
72.7B
145 GB on disk
Likes
38
Public
Repo makeup
Click a slice to open those files.
.safetensors145 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- qwen2
- Access
- Public
- Created
- Sep 30, 2024
- Updated
- Oct 7, 2024
- SHA
- bb553dd1
Try a prompt
Base models
Model card
From the Hugging Face model README
Rombos-LLM-V2.5-Qwen-72b
Rombos-LLM-V2.5-Qwen-72b is a continues finetuned version of Qwen2.5-72B. I noticed recently that the Qwen team did not learn from my methods of continuous finetuning, the great benefits, and no downsides of it. So I took it upon myself to merge the instruct model with the base model myself using the Ties merge method
This version of the model shows higher performance than the original instruct and base models.
Quants: (Coming soon)
GGUF: https://huggingface.co/bartowski/Replete-LLM-V2.5-Qwen-72b-GGUF
EXL2:
Benchmarks: (Coming soon)
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 45.39 |
| IFEval (0-Shot) | 71.55 |
| BBH (3-Shot) | 61.27 |
| MATH Lvl 5 (4-Shot) | 47.58 |
| GPQA (0-shot) | 19.80 |
| MuSR (0-shot) | 17.32 |
| MMLU-PRO (5-shot) | 54.83 |
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- other
- Featherless Ai
- live
- Created
- Sep 30, 2024
- Updated
- Oct 7, 2024