Downloads · 30 days
115
3% of all-time downloads
Qwen2-1.5B-Instruct-Abliterated-iMat-GGUF
cgus/Qwen2-1.5B-Instruct-Abliterated-iMat-GGUF
Qwen2-1.5B-Instruct-Abliterated-iMat-GGUF is a machine learning model from cgus. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Model: Qwen2-1.5B-Instruct-Abliterated Made by: trollek
All-time downloads
4.1K
Public
Repo size
15.4 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf15.4 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jun 16, 2024
- Updated
- Dec 16, 2024
- SHA
- f680df86
Base models
Model card
From the Hugging Face model README
Qwen2-1.5B-Instruct-Abliterated-GGUF
Model: Qwen2-1.5B-Instruct-Abliterated
Made by: trollek
Based on original model: Qwen2-1.5B-Instruct
Created by: Qwen
Quantization notes
Made with llama.cpp-b3154 with imatrix file based on Exllamav2 default dataset.
01.09.2024: Added Q4_0_4_4 (low end ARM CPUs), Q4_0_4_8 and Q4_0_8_8 (high end ARM CPUs).
On my PC with i7-3770 CPU these are significantly slower than Q4_K_M.
On my phone Q4_0_4_4 is marginally faster than Q4_K_M.
17.12.2024: Readme update. It seems Q4_0_4_4, Q4_0_4_8 and Q4_0_8_8 support was removed in recent llama.cpp. I'll keep them but they might be no longer useful.
Original model card
This is an abliterated version of Qwen2-1.5B-Instruct using the same procedure as augmxnt/Qwen2-7B-Instruct-deccp with their code on Github with some added lines from mlabonne/harmful_behaviors to the harmful.txt file.
I have not done anything else to the model. Yet.
- License
- apache-2.0
- Created
- Jun 16, 2024
- Updated
- Dec 16, 2024