Downloads · 30 days
5
3% of all-time downloads
Rombos-LLM-V2.5-Qwen-32b-4.0bpw-exl2
jth01/Rombos-LLM-V2.5-Qwen-32b-4.0bpw-exl2
Rombos-LLM-V2.5-Qwen-32b-4.0bpw-exl2 is a text generation model from jth01. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
4 bpw quant of https://huggingface.co/rombodawg/Rombos-LLM-V2.5-Qwen-32b
All-time downloads
152
Public
Repo size
17.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors17.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Oct 24, 2024
- Updated
- Oct 24, 2024
- SHA
- 914b28d3
Try a prompt
Base models
Model card
From the Hugging Face model README
Rombos-LLM-V2.5-Qwen-32b 4.0 BPW exl2
4 bpw quant of https://huggingface.co/rombodawg/Rombos-LLM-V2.5-Qwen-32b
Scores 63.2 on Aider benchmarks!
Rombos-LLM-V2.5-Qwen-32b
Rombos-LLM-V2.5-Qwen-32b is a continues finetuned version of Qwen2.5-32B. I noticed recently that the Qwen team did not learn from my methods of continuous finetuning, the great benefits, and no downsides of it. So I took it upon myself to merge the instruct model with the base model myself using the Ties merge method
This version of the model shows higher performance than the original instruct and base models.
Quants: (Coming soon)
GGUF: https://huggingface.co/bartowski/Replete-LLM-V2.5-Qwen-32b-GGUF
EXL2:
Benchmarks: (Coming soon)
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Created
- Oct 24, 2024
- Updated
- Oct 24, 2024