Downloads · 30 days
154
12% of all-time downloads
kabachuha/G4-MeroMero-v2-31B-Heretic-ARA-LoRA-GGUF
G4-MeroMero-v2-31B-Heretic-ARA-LoRA-GGUF is a image-text-to-text model from kabachuha. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Made with the new 4bit ARA LoRA (usearalora) technique at home.
Downloads · 30 days
154
12% of all-time downloads
All-time downloads
1.3K
Public
Repo size
321 MB
Likes
4
Public
Click a slice to open those files.
.gguf321 MB · 100%
From the Hugging Face model README
Made with the new 4bit ARA LoRA (use_ara_lora) technique at home.
llama.cpp example command:
./llama-server <your current command> --lora-scaled "/media/kabachuha/doc/G4-MeroMero-v2-31B-Heretic-ARA-LoRA.gguf:1.0"
For unquantized: https://huggingface.co/kabachuha/G4-MeroMero-v2-31B-Heretic-ARA-LoRA.
| Metric | This model | Original model (G4-MeroMero-v2-31B) |
|---|---|---|
| KL divergence | 0.0785 | 0 (by definition) |
| Refusals | 8/100 | 97/100 |
Lower refusals indicate fewer content restrictions, while lower KL divergence indicates more closeness to the original model's baseline. Higher refusals cause more rejections, objections, pushbacks, lecturing, censorship, softening and deflections.
| Parameter | Value |
|---|---|
| start_layer_index | 26 |
| end_layer_index | 52 |
| preserve_good_behavior_weight | 0.8949 |
| steer_bad_behavior_weight | 0.0025 |
| overcorrect_relative_weight | 0.9535 |
| neighbor_count | 15 |