Downloads · 30 days
19
58% of all-time downloads
TheMelonGod/Falcon3-1B-Base-exl3
Falcon3-1B-Base-exl3 is a machine learning model from TheMelonGod. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
Original model by: tiiuae Original model: Falcon3-1B-Base
Downloads · 30 days
19
58% of all-time downloads
All-time downloads
33
Public
Repo size
16 GB
Likes
0
Public
Click a slice to open those files.
.md2.1 KB · 58%
From the Hugging Face model README
Original model by: tiiuae
Original model: Falcon3-1B-Base
For more information about the model, check out the original model page and the creator while you're at it.
<!-- EXL3-VARIANTS-START -->ExLlamaV3 Quantizations:
8.0bpw: 8hb | 6hb
7.0bpw: 8hb | 6hb
6.0bpw: 6hb
5.0bpw: 6hb
4.0bpw: 6hb
3.0bpw: 6hb
2.5bpw: 6hb
2.25bpw: 6hb
2.0bpw: 6hb
Made with EXL3 Version: 1.4.4
If you need a specific bits-per-weight or head-bits combo, please let me know. I’m happy to help.
Your feedback and suggestions are always welcome! They help me improve and make quantizations better for everyone.
Special thanks to turboderp for developing the tools that made these quantizations possible. Your contributions are greatly appreciated!