Downloads · 30 days
22
5% of all-time downloads
bobber/Huihui-Qwen3.5-0.8B-abliterated-onnx
Huihui-Qwen3.5-0.8B-abliterated-onnx is a image-text-to-text model from bobber. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers.js. The card lists the license as apache-2.0.
ONNX export of huihui-ai/Huihui-Qwen3.5-0.8B-abliterated for browser-side inference with WebGPU via transformers.js.
Downloads · 30 days
22
5% of all-time downloads
All-time downloads
450
Public
Repo size
5.6 GB
Likes
0
Public
Click a slice to open those files.
.bin4 GB · 72%
From the Hugging Face model README
ONNX export of huihui-ai/Huihui-Qwen3.5-0.8B-abliterated for browser-side inference with WebGPU via transformers.js.
This is the base abliterated model without any LoRA or fine-tuning.
huihui-ai/Huihui-Qwen3.5-0.8B-abliteratedonnx-community/Qwen3.5-0.8B-ONNXSee ONNX_CONVERSION_GUIDE.md for detailed pipeline documentation.
Try it: bobber/routangseng-chat
import { Qwen3_5ForConditionalGeneration, AutoProcessor } from '@huggingface/transformers';
const model = await Qwen3_5ForConditionalGeneration.from_pretrained(
'bobber/Huihui-Qwen3.5-0.8B-abliterated-onnx',
{ dtype: { embed_tokens: 'q8', vision_encoder: 'q8', decoder_model_merged: 'q8' }, device: 'webgpu' }
);
| File | Size | Description |
|---|---|---|
onnx/decoder_model_merged_quantized.onnx + .onnx_data | ~721 MB | Decoder (q8, MatMul-only) |
onnx/embed_tokens_quantized.onnx + .onnx_data | ~243 MB | Embeddings (q8) |
onnx/vision_encoder_quantized.onnx + .onnx_data | ~96 MB | Vision encoder (q8, from reference) |