Downloads · 30 days
22
6% of all-time downloads
zandzpider/Qwen3-30B-A3B-abliterated-erotic-autoround-int4
Qwen3-30B-A3B-abliterated-erotic-autoround-int4 is a machine learning model from zandzpider. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
4-bit AutoRound quantization of Qwen3-30B-A3B-abliterated-erotic.
Downloads · 30 days
22
6% of all-time downloads
All-time downloads
373
Public
Parameters
623M
16.8 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors16.8 GB · 100%
How the weights are stored.
I323.8B · 81%
From the Hugging Face model README
4-bit AutoRound quantization of Qwen3-30B-A3B-abliterated-erotic.
from vllm import LLM, SamplingParams
llm = LLM(
model="yourusername/Qwen3-30B-A3B-abliterated-erotic-autoround-int4",
quantization="auto-round",
dtype="float16",
gpu_memory_utilization=0.9,
max_model_len=16384,
trust_remote_code=True,
)
sampling_params = SamplingParams(temperature=0.7, max_tokens=512)
outputs = llm.generate(["Your prompt here"], sampling_params)
Hardware Requirements
- VRAM: 18-20GB
- Inference Speed: average 231 tokens/sec on 1x RTX 3090
Base Model
Based on https://huggingface.co/Ewere/Qwen3-30B-A3B-abliterated-erotic