Downloads · 30 days
15
2% of all-time downloads
refortifai/Qwen3-4B-obfuscated
Qwen3-4B-obfuscated is a text generation model from refortifai. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
We obfuscated an AI model using a novel post-training transformation. Can you figure out how?
Downloads · 30 days
15
2% of all-time downloads
All-time downloads
722
Public
Parameters
4B
8.1 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors8 GB · 100%
From the Hugging Face model README
We obfuscated an AI model using a novel post-training transformation. Can you figure out how?
We've published two models on HuggingFace: the original Qwen3-4B and this refortif.ai-obfuscated version of the same model. Your goal: figure out the mathematical transform we applied to the weights.
| Model | Link | |
|---|---|---|
| Original | Qwen3-4B | huggingface.co/Qwen/Qwen3-4B |
| Obfuscated | Qwen3-4B (refortif.ai) | huggingface.co/refortifai/Qwen3-4B-obfuscated |
Download both models, compare the weights, and reverse-engineer the transformation.
| Base Model | Qwen/Qwen3-4B |
| Parameters | 4 billion |
| Tensor Type | BF16 |
| Format | Safetensors |
| Hidden Size | 2560 |
| Layers | 36 |
| Attention Heads | 32 (8 KV heads, GQA) |
| Head Dimension | 128 |
| Intermediate Size | 9728 |
| License | Apache 2.0 |
The architecture and config are identical to the original Qwen3-4B. Only the weights have been transformed.
huggingface-cli download refortifai/Qwen3-4B-obfuscated --local-dir ./Qwen3-4B-obfuscated
To download the original for comparison:
huggingface-cli download Qwen/Qwen3-4B --local-dir ./Qwen3-4B
We've open-sourced a visual diff tool to help you get started. It loads both models one tensor at a time (memory-efficient) and gives you per-layer statistics, cosine similarity, histograms, heatmaps, and more.
github.com/refortif-ai/diffstat
git clone https://github.com/refortif-ai/diffstat.git
cd diffstat
pip install -e .
python -m diff_qwen models/Qwen3-4B models/Qwen3-4B-obfuscated
Then open http://localhost:8787 in your browser.
Load the obfuscated model in any standard framework and see what happens:
> The meaning of life is
████████████████████ (garbage output)
The obfuscated weights produce completely unusable output in vLLM, HuggingFace Transformers, or any other standard inference engine. On the refortif.ai runtime, the same weights produce correct, coherent output with minimal overhead.
Think you've cracked it? We want to hear from you. Send us your insights, approaches, and analysis. Partial findings are welcome too.
Fearless model distribution with zero IP theft risk.
refortif.ai provides post-training model obfuscation that lets you ship your models anywhere without exposing your weights. The obfuscated model is mathematically unusable without the refortif.ai runtime, but runs with near-zero performance overhead when properly deployed.
Want to obfuscate your own models? [email protected]