Downloads · 30 days
9
15% of all-time downloads
Dumpling-Qwen2.5-32B-v2-exl3-4.5bpw-hb8
MetaphoricalCode/Dumpling-Qwen2.5-32B-v2-exl3-4.5bpw-hb8
Dumpling-Qwen2.5-32B-v2-exl3-4.5bpw-hb8 is a text generation model from MetaphoricalCode. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- Original model: https://huggingface.co/nbeerbower/Dumpling-Qwen2.5-32B-v2 - exllamav3: https://github.com/turboderp-org/exllamav3 ---
All-time downloads
61
Public
Parameters
10B
19.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors19.9 GB · 100%
Parameter types
How the weights are stored.
I169.2B · 92%
Try a prompt
Base models
Model card
From the Hugging Face model README
Quantized using the default exllamav3 (0.0.2) quantization process.
- Original model: https://huggingface.co/nbeerbower/Dumpling-Qwen2.5-32B-v2
- exllamav3: https://github.com/turboderp-org/exllamav3
Dumpling-Qwen2.5-32B-v2
nbeerbower/Rombos-EVAGutenberg-TIES-Qwen2.5-32B finetuned on:
- nbeerbower/GreatFirewall-DPO
- nbeerbower/Schule-DPO
- nbeerbower/Purpura-DPO
- nbeerbower/Arkhaios-DPO
- jondurbin/truthy-dpo-v0.1
- antiven0m/physical-reasoning-dpo
- flammenai/Date-DPO-NoAsterisks
- flammenai/Prude-Phi3-DPO
- Atsunori/HelpSteer2-DPO
- jondurbin/gutenberg-dpo-v0.1
- nbeerbower/gutenberg2-dpo
- nbeerbower/gutenberg-moderne-dpo.
Method
QLoRA ORPO tuned with 8x A100 for 2 epochs. Rank 64 LoRA, 2e-5 learning rate.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Created
- May 28, 2025
- Updated
- May 28, 2025