Downloads · 30 days
5
11% of all-time downloads
Rombos-LLM-V2.5-Qwen-32b-exl2_4.5bpw
async0x42/Rombos-LLM-V2.5-Qwen-32b-exl2_4.5bpw
Rombos-LLM-V2.5-Qwen-32b-exl2_4.5bpw is a text generation model from async0x42. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
47
Public
Repo size
19.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors19.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Oct 27, 2024
- Updated
- Oct 27, 2024
- SHA
- 89b30b66
Try a prompt
Base models
Model card
From the Hugging Face model README
Rombos-LLM-V2.5-Qwen-32b
Rombos-LLM-V2.5-Qwen-32b is a continues finetuned version of Qwen2.5-32B. I noticed recently that the Qwen team did not learn from my methods of continuous finetuning, the great benefits, and no downsides of it. So I took it upon myself to merge the instruct model with the base model myself using the Ties merge method
This version of the model shows higher performance than the original instruct and base models.
Quants: (Coming soon)
GGUF: https://huggingface.co/bartowski/Replete-LLM-V2.5-Qwen-32b-GGUF
EXL2:
Benchmarks: (Coming soon)
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Created
- Oct 27, 2024
- Updated
- Oct 27, 2024