Phi-4-mini-instruct-abliterated-q4f16_1-MLC

Phi-4-mini-instruct abliterated · MLC q4f16_1

An uncensored Phi-4-mini, quantized to 4-bit MLC format for in-browser inference via WebGPU.

This is an MLC-ready build of huihui-ai/Phi-4-mini-instruct-abliterated, itself an abliterated (refusal-removed) variant of Microsoft's Phi-4-mini-instruct. The weights are quantized to q4f16_1 (4-bit weights, 16-bit activations) and packaged for use with MLC-LLM and WebLLM.

Everything runs on-device — no server, no API key, no data leaves your machine.

What abliteration means

Abliteration is a surgical edit to the model weights that removes the trained refusal behavior without retraining. The architecture and tokenizer are identical to the stock Phi-4-mini; only the weight values differ. This means the model will engage with topics that the original would refuse, but it also means there are no safety guardrails between you and the raw model output.

This is sovereignty taken to its conclusion: your hardware, your data, your judgment — and your responsibility for how you use it.

Model details

Usage

WebLLM (in-browser, WebGPU)

This model reuses the prebuilt WebAssembly model_lib from the stock Phi-4-mini in WebLLM's catalog (Phi-4-mini-instruct-q4f16_1-MLC), since the architecture is identical — only weight values change.

import { CreateMLCEngine, prebuiltAppConfig } from "@mlc-ai/web-llm";

// Borrow the prebuilt model_lib (WASM) from the stock Phi-4-mini record
const baseRecord = prebuiltAppConfig.model_list.find(
  m => m.model_id === "Phi-4-mini-instruct-q4f16_1-MLC"
);

const engine = await CreateMLCEngine(
  "Phi-4-mini-instruct-abliterated-q4f16_1-MLC",
  {
    appConfig: {
      model_list: [{
        model: "https://huggingface.co/aipster/Phi-4-mini-instruct-abliterated-q4f16_1-MLC/resolve/main/",
        model_id: "Phi-4-mini-instruct-abliterated-q4f16_1-MLC",
        model_lib: baseRecord.model_lib,
        overrides: { context_window_size: 4096 },
      }],
    },
  }
);

const reply = await engine.chat.completions.create({
  messages: [{ role: "user", content: "Explain how a pin-tumbler lock works." }],
});
console.log(reply.choices[0].message.content);

MLC-LLM (native, CLI)

mlc_llm chat HF://aipster/Phi-4-mini-instruct-abliterated-q4f16_1-MLC --device vulkan

Try it live

This model powers the top-tier slot in the AIpster Local AI Playground — a browser-based playground where every model runs entirely on your GPU via WebGPU. No sign-up required for smaller models; this one is available to AIpster members.

How these weights were built

1. Downloaded source weights from huihui-ai/Phi-4-mini-instruct-abliterated (safetensors, bf16).
2. Built MLC-LLM from source inside the mlcaidev/package-cpu Docker image (the pip nightly was ABI-broken for linux x86_64 at time of conversion).
3. Ran mlc_llm convert_weight with --quantization q4f16_1 to produce the 66 weight shards.
4. Ran mlc_llm gen_config with --conv-template phi-4 to produce mlc-chat-config.json.
5. Validated the output tensor-cache.json against the official mlc-ai/Phi-4-mini-instruct-q4f16_1-MLC reference: 66 records, 323 parameters, identical names and shapes — confirming safe reuse of the prebuilt WebAssembly model_lib.

Caveats

• Uncensored means unfiltered. The model will produce output that a stock model would refuse. There is no safety net. You are responsible for what you do with it.
• Still a small model. 3.8B parameters is capable but not frontier. It can be confidently wrong on precise facts, names, and numbers. Treat its claims with the same skepticism you would apply to any local model.
• WebGPU requirements. In-browser inference needs a GPU with WebGPU support (Chrome 113+ or Edge 113+ on desktop). Expect ~3.4 GB of VRAM usage. On integrated graphics or mobile, the model may fail to load.

Attribution

• Original model: microsoft/Phi-4-mini-instruct (MIT License, © Microsoft Corporation)
• Abliteration: huihui-ai/Phi-4-mini-instruct-abliterated (MIT License)
• MLC quantization & packaging: AIpster (aipster.com)
• Abliteration method: remove-refusals-with-transformers

License

MIT — inherited from the base model chain. See microsoft/Phi-4-mini-instruct for the original license terms.