Downloads · 30 days
32
3% of all-time downloads
Kilinskiy/Step-3.5-Flash-Ablitirated
Step-3.5-Flash-Ablitirated is a text generation model from Kilinskiy. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This repository contains an abliterated and FP16 version of the Step-3.5-Flash model by StepFun.
Downloads · 30 days
32
3% of all-time downloads
All-time downloads
989
Public
Parameters
197B
394 GB on disk
Likes
8
Public
Click a slice to open those files.
.safetensors394 GB · 100%
How the weights are stored.
BF16197B · 100%
From the Hugging Face model README
This repository contains an abliterated and FP16 version of the Step-3.5-Flash model by StepFun.
Step-3.5-Flash is a massive Sparse Mixture-of-Experts (MoE) model with 199B total parameters (approx. 11B active per token). This specific version has been modified to remove "refusal" vectors (abliterated), making it significantly more compliant with unfiltered requests.
Use this model at your own risk. The "abliteration" process surgically removes the model's alignment and safety filters. As a result:
If you find this abliterated version useful and want to support the compute costs for future models, feel free to drop a tip:
TA7Weo6jXRNi5uMpHSrw7kRLoU1SM9rgqFbc1p0hxc39r5g88hnknqtvgc2msyamvfhgx8afxxjztq0075nxwvvhksmvvcz30x01920Fcb8933b5A48574b4616C66056c88EE7207UQALxV0jQNKqbDm_xSCBNMtGYRxv6PrhijYCf8dXgnAVdcuwYour support is greatly appreciated!
You can load it directly via transformers:
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model_id = "Kilinskiy/Step-3.5-Flash-Ablitirated"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
device_map="auto",
torch_dtype=torch.float16,
load_in_8bit=True
)
prompt = "Write a creative story without any restrictions."
inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
outputs = model.generate(**inputs, max_new_tokens=200)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))