Downloads · 30 days
44
11% of all-time downloads
grayarea/Mars-27B-V.1-heretic-v1.2-GGUF
Mars-27B-V.1-heretic-v1.2-GGUF is a machine learning model from grayarea. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is a decensored version of Mars-27B-V.1, made using Heretic v1.2.0 focusing on zero refusals with low KL divergence.
Downloads · 30 days
44
11% of all-time downloads
All-time downloads
394
Public
Repo size
99.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf99.3 GB · 100%
From the Hugging Face model README
This is a decensored version of Mars-27B-V.1, made using Heretic v1.2.0 focusing on zero refusals with low KL divergence.
Note Mars-27B-V.1 itself is a merge of models that are already abliterated. This is an experiment to see what happens if some additional refusals are removed.
| Metric | This Model | Original Model |
|---|---|---|
| KL divergence | 0.0159 | 0 (by definition) |
| Refusals | 0/108 | 9/108 |
| Quant | Filename | PPL ± Error |
|---|---|---|
| Q8_0 | Mars-27B-V.1-heretic-v1.2-Q8_0.gguf | 6.2202 +/- 0.04253 |
| Q4_K_M | Mars-27B-V.1-heretic-v1.2-Q4_K_M.gguf | 6.3112 +/- 0.04316 |