Downloads · 30 days
28
3% of all-time downloads
ZR1-1.5B-exl2
TheMelonGod/ZR1-1.5B-exl2
ZR1-1.5B-exl2 is a text generation model from TheMelonGod. Use it when you need the model to write or continue text. The card lists the license as mit.
Orignal Model by: Zyphra Orignal Model: ZR1-1.5B
All-time downloads
905
Public
Repo size
74.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json1.6 MB · 100%
At a glance
- Task
- Text Generation
- License
- mit
- Access
- Public
- Created
- Apr 17, 2025
- Updated
- Apr 18, 2025
- SHA
- e1d0c272
Try a prompt
Base models
Model card
From the Hugging Face model README
Orignal Model by: Zyphra
Orignal Model: ZR1-1.5B
For more information about the model, I highly recommend checking out the original model page and the creator while you're at it.
My Testing Methods don't work for reasoning models so please let me know how well these do work if they work at all.
ExLlamaV2 Quantizations:
8.0bpw: 8hb | 6hb
7.75bpw: 8hb | 6hb
7.5bpw: 8hb | 6hb
7.25bpw: 8hb | 6hb
7.0bpw: 8hb | 6hb
6.75bpw: 8hb | 6hb
6.5bpw: 8hb | 6hb
6.25bpw: 8hb | 6hb
6.0bpw: 8hb | 6hb
5.75bpw: 8hb | 6hb
5.5bpw: 8hb | 6hb
5.25bpw: 8hb | 6hb
5.0bpw: 8hb | 6hb
4.75bpw: 8hb | 6hb
4.5bpw: 8hb | 6hb
4.25bpw: 8hb | 6hb
4.0bpw: 8hb | 6hb
3.75bpw: 8hb | 6hb
3.5bpw: 8hb | 6hb
3.25bpw: 8hb | 6hb
3.0bpw: 8hb | 6hb
2.75bpw: 8hb | 6hb
2.5bpw: 8hb | 6hb
2.25bpw: 8hb | 6hb
2.0bpw: 8hb | 6hb
Measurement File (Default/built-in calibration dataset was used)
If you need a specific model quantized or particular bits per weight, please let me know. I’m happy to help.
Your feedback and suggestions are always welcome! They help me improve and make quantizations better for everyone.
Special thanks to turboderp for developing the tools that made these quantizations possible. Your contributions are greatly appreciated!
- Task
- Text Generation
- License
- mit
- Languages
- en
- Created
- Apr 17, 2025
- Updated
- Apr 18, 2025