Downloads · 30 days
11
15% of all-time downloads
Negative_LLAMA_70B_EXL3_d_1.45bpw
SicariusSicariiStuff/Negative_LLAMA_70B_EXL3_d_1.45bpw
Negative_LLAMA_70B_EXL3_d_1.45bpw is a text generation model from SicariusSicariiStuff. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This was made to test extremely low quants. 70B is almost usable at 1.45 bpw. A custom strategy for quanting was used, for details check EXL3 repo. This is borderline usable, the goal was to run 70b model under 16gb o…
All-time downloads
74
Public
Parameters
7.8B
15.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors15.7 GB · 100%
Parameter types
How the weights are stored.
I166.8B · 86%
Try a prompt
Base models
Model card
From the Hugging Face model README
Note
This was made to test extremely low quants. 70B is almost usable at 1.45 bpw. A custom strategy for quanting was used, for details check EXL3 repo. This is borderline usable, the goal was to run 70b model under 16gb of vram. If you have 16GB VRAM use 4k context and it will fit, and sort of work. very borderline, but can be used.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Jul 8, 2025
- Updated
- Jul 8, 2025