Downloads · 30 days
154
9% of all-time downloads
byliuliu/faithful-h3-qwen3.5-9b-abliterated-v2
faithful-h3-qwen3.5-9b-abliterated-v2 is a text generation model from byliuliu. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This repository provides the model files used by the local liuliu Faithful H3 Web tool.
Downloads · 30 days
154
9% of all-time downloads
All-time downloads
1.7K
Public
Repo size
14.6 GB
Likes
0
Public
Click a slice to open those files.
.safetensors9 GB · 61%
From the Hugging Face model README
This repository provides the model files used by the local liuliu Faithful H3 Web tool.
The checkpoint and companion tokenizer/configuration files are distributed for local use with the linked tool. This repository does not claim authorship or ownership of the model.
Qwen3.5-9B-Abliterated_v2_quanto_bf16_int8.safetensors8,957,488,932 byteseb03df5ccba4536eb64cf096c08b068eb84cfd2d2aa798cd45f31a0f67e339e6The application verifies both the exact file size and SHA256 before loading the checkpoint. The older non-v2 checkpoint is not interchangeable and is not included here.
The Faithful H3 application loads the text-only Qwen3.5 9B checkpoint with Transformers and Optimum Quanto on a CUDA-capable NVIDIA GPU. The repository includes the tokenizer, chat template, vocabulary, and model configuration needed by that runtime.
An optional llama.cpp GGUF variant is also available for the lightweight local backend.
Qwen3.5-9B-Abliterated-text-Q4_K_M_bis.gguf5,627,044,704 bytesdba64d0e5cce0739e27535ee0a6b75249eb8006ce8b2d6c060e20750035c4695The GGUF file is a separately quantized distribution. It does not replace the existing Quanto checkpoint or its companion files.
This is a third-party model artifact. Review the Qwen model terms, base-model licenses, and all applicable laws before using, modifying, or redistributing it. The license: other metadata is deliberately conservative because this repository does not grant additional model rights.