Downloads · 30 days
299
20% of all-time downloads
micymike/Qwen2.5-Coder-3B-Abliterated
Qwen2.5-Coder-3B-Abliterated is a machine learning model from micymike. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is an abliterated (uncensored) version of the Qwen/Qwen2.5-Coder-3B-Instruct model. The model's refusal mechanisms have been mathematically projected out of its weight matrices using orthogonalization techniques…
Downloads · 30 days
299
20% of all-time downloads
All-time downloads
1.5K
Public
Parameters
3.1B
17.6 GB on disk
Likes
1
Public
Click a slice to open those files.
.gguf11.4 GB · 65%
From the Hugging Face model README
This is an abliterated (uncensored) version of the Qwen/Qwen2.5-Coder-3B-Instruct model.
The model's refusal mechanisms have been mathematically projected out of its weight matrices using orthogonalization techniques (representation engineering).
The creator of this model is NOT liable for any misuse, illegal activities, or harmful outputs generated by this model. By using this model, you agree to take full responsibility for any consequences that arise from its application. This model is provided strictly for educational and research purposes to understand the mechanics of AI alignment and representation engineering.
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("micymike/Qwen2.5-Coder-3B-Abliterated")
tokenizer = AutoTokenizer.from_pretrained("micymike/Qwen2.5-Coder-3B-Abliterated")
prompt = "Write a Python script to..."
messages = [{"role": "user", "content": prompt}]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=100)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))