Downloads · 30 days
12
5% of all-time downloads
dominant-strategies/Qwen3.6-27B-heretic-pearl
Qwen3.6-27B-heretic-pearl is a image-text-to-text model from dominant-strategies. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
A Pearl-quantized build of Qwen3.6-27B (heretic / decensored), prepared so that running inference simultaneously performs Pearl Proof-of-Useful-Work. The weight matmuls that drive token generation are int7 GEMMs in th…
Downloads · 30 days
12
5% of all-time downloads
All-time downloads
223
Public
Parameters
27.4B
28.3 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors28.3 GB · 100%
How the weights are stored.
I827.2B · 98%
From the Hugging Face model README
A Pearl-quantized build of Qwen3.6-27B (heretic / decensored), prepared so that running inference simultaneously performs Pearl Proof-of-Useful-Work. The weight matmuls that drive token generation are int7 GEMMs in the exact shape Pearl's mining kernel consumes - so serving this model with the Pearl vLLM plugin merge-mines the Pearl chain at the same time.
This is the e8 build - the exact artifact running in production on an
RTX 5090 (sm_120). It is byte-for-byte the model the miner loads, so a deployment
can pull it straight from here and match the running serve.
Inputs/outputs and chat behavior are identical to the underlying model - this repo only changes the numeric format of the weights (+ the embedding), not the architecture or the tokenizer.
⚠️ Hardware - RTX 5090 only. The turnkey inference miner that serves this model and mines Pearl (
jonathanquai/alpha-inference-mineron Docker Hub; source: https://github.com/jdowning100/alpha-inference-miner) is supported only on the NVIDIA RTX 5090 (sm_120). Other GPUs are not supported.
Qwen/Qwen3.6-27B
model_type: qwen3_5, image-text-to-text, with the 15 MTP heads intact).llmfan46/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved
The model is quantized with quant_method: "pearl", format: "int-quantized". The
scheme is int7 weights on every matmul layer (so each is a valid Pearl mining
GEMM), with a small set of layers deliberately left in higher precision for
quality, plus an int8 token embedding to claw back VRAM for context.
int7 (7-bit), per-channel, symmetric, with dynamic int7 input activations - applied to:
| Layer | Regex |
|---|---|
| Attention projections | self_attn.{q,k,v,o}_proj |
| MLP projections | mlp.{gate,up,down}_proj |
| Linear-attention projections | linear_attn.{in_proj_qkv,in_proj_z,out_proj} |
| LM head | lm_head |
Left in bf16 (not quantized) - all *norm*, the entire vision tower
(*.visual.*), and the linear-attention internals that are numerically sensitive
(in_proj_a, in_proj_b, conv1d, A_log, dt_bias). The token embedding is
int8, not bf16 - see the e8 note below.
The e8 part - int8 token embedding. The 248,320-row embed_tokens table is
stored as int8 (I8 weights with per-row bf16 dequant scales) - excluded from the
int7 group and handled by the plugin's embedding patch. On a 32 GiB card this frees
~1.2 GiB, which we spend on a much larger KV-cache / context window at no measurable
quality or throughput cost.
Net effect: the heavy GEMMs (attention, MLP, linear-attn, LM head) are int7 - ~7×
smaller than bf16 and in Pearl's Int7xInt7→Int32 mining shape - while norms, the
vision encoder, and the mamba/linear-attention internals keep full precision, and
the embedding is int8.
Pearl's Proof-of-Useful-Work is a noisy int7 × int7 → int32 GEMM whose folded
transcript is hashed against the difficulty target. By quantizing the model's
matmuls to that exact format, the Pearl GPU kernel (pearl_gemm) computes the
clean inference output and a mining share from the same matmul. A prefill burst
therefore both answers the prompt and submits real, consensus-valid pool shares -
"useful work" in the literal sense.
This model requires the Pearl vLLM plugin (quant_method: pearl) and the
pearl_gemm CUDA kernels; stock vLLM/transformers will not interpret the pearl
quantization. Target GPU: sm_120 (RTX 5090 / 5080); the build is the multimodal
(VL) variant.
# with the Pearl plugin installed (vllm_miner + pearl_gemm):
from vllm import LLM
llm = LLM(
model="dominant-strategies/Qwen3.6-27B-heretic-pearl",
quantization="pearl",
dtype="bfloat16",
trust_remote_code=True,
)
The turnkey merge-mining miner pulls this repo, serves it with the lazy-load controller (model sleeps when idle so the GPU mines at full rate, wakes ~1.2 s on a chat, prefill merge-mines), and submits shares to a Pearl pool.
Standard transformers layout: config.json (with the pearl quantization_config),
12 sharded *.safetensors + model-auxiliary.safetensors, model.safetensors.index.json,
tokenizer, chat template, and the vision/video preprocessor configs.
Apache-2.0, following the Qwen3.6-27B license. Base architecture by Qwen; decensoring by llmfan46; Pearl quantization and packaging by dominant-strategies. This is a derivative redistributed for use on the Pearl network.