Downloads · 30 days
6
3% of all-time downloads
NaturalLM-exl2
TheMelonGod/NaturalLM-exl2
NaturalLM-exl2 is a text generation model from TheMelonGod. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
ExLlamaV2 quantizations of: qingy2019 - NaturalLM
All-time downloads
210
Public
Repo size
138 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json2.3 MB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Nov 23, 2024
- Updated
- Nov 24, 2024
- SHA
- 97472771
Try a prompt
Base models
Model card
From the Hugging Face model README
ExLlamaV2 quantizations of: qingy2019 - NaturalLM
Quantizations (6hb)
8.0bpw
7.5bpw
7.0bpw
6.5bpw
6.0bpw
5.5bpw
5.0bpw
4.5bpw
4.25bpw
4.0bpw
3.75bpw
3.5bpw
3.0bpw
2.75bpw
2.5bpw
2.25bpw
2.0bpw
If you need a specific model quantization or a particular bits per weight, please let me know. I’m happy to help quantize lesser known models.
If you have any suggestions for improvements or feedback, feel free to reach out. Your input is greatly appreciated and helps me make quantizations better for everyone.
Special thanks to turboderp for developing the tools that made these quantizations possible. Your contributions are greatly appreciated!
- Task
- Text Generation
- License
- apache-2.0
- Languages
- en
- Created
- Nov 23, 2024
- Updated
- Nov 24, 2024