Downloads · 30 days
95
17% of all-time downloads
l4zy0n3/Ornith-1.5-35B-A3B-ZeroFuse-AD-IQ3S-IQ3XXS-GGUF
Ornith-1.5-35B-A3B-ZeroFuse-AD-IQ3S-IQ3XXS-GGUF is a image-text-to-text model from l4zy0n3. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as apache-2.0.
An importance-matrix quant of junafinity/Ornith-1.5-35B-A3B-uncensored-GGUF-8bit, an abliterated build of ornith-ai/Ornith-1.5-35B-A3B.
Downloads · 30 days
95
17% of all-time downloads
All-time downloads
564
Public
Repo size
16.6 GB
Likes
1
Public
Click a slice to open those files.
.gguf16.6 GB · 100%
From the Hugging Face model README
An importance-matrix quant of
junafinity/Ornith-1.5-35B-A3B-uncensored-GGUF-8bit,
an abliterated build of
ornith-ai/Ornith-1.5-35B-A3B.
This mixed quant targets a 16 GB-class CUDA deployment with long context by spending precision on shared, attention, recurrent, router, embedding, and output tensors while compressing the large routed-expert tensors more heavily.
| File | Purpose | Size |
|---|---|---|
Ornith-1.5-35B-A3B-ZeroFuse-AD-IQ3_S-IQ3_XXS.gguf | Language model | 15.51 GB / 14.45 GiB |
mmproj-Ornith-1.5-35B-A3B-uncensored-f16.gguf | Vision projector from Junafinity's source repo | 899 MB |
imatrix/imatrix.gguf | Importance matrix used for this quant | 192 MB |
logs/quantize-AD-IQ3_S-IQ3_XXS.log | Full quantization log | 123 KB |
Download the model and mmproj files for image input. The model alone supports
text input.
| Tensor group | Precision |
|---|---|
Routed-expert ffn_down_exps | IQ3_XXS |
Routed-expert ffn_gate_exps | IQ2_S |
Routed-expert ffn_up_exps | IQ2_S |
| Other eligible tensors | Q8_0 |
| Norm, router, recurrent-state, and required scalar tensors | F32 |
Quantization facts:
7221e24f5.The importance matrix is included so the tensor-selection work is inspectable and reusable.
mmproj file. Junafinity
verified that the vision tower was unchanged by ZeroFuse abliteration.0..39 only. Do not advertise or
configure it as an MTP draft model.llama-server \
--model Ornith-1.5-35B-A3B-ZeroFuse-AD-IQ3_S-IQ3_XXS.gguf \
--mmproj mmproj-Ornith-1.5-35B-A3B-uncensored-f16.gguf \
--ctx-size 102400 \
--n-gpu-layers all \
--n-cpu-moe 16 \
--flash-attn on \
--cache-type-k q4_0 \
--cache-type-v q4_0 \
--jinja \
--host 127.0.0.1 \
--port 8082
--n-cpu-moe 16 is a memory-fit profile, not a universal recommendation.
Tune CPU expert offload, context size, KV precision, and batching for your
hardware. KV mean-centering is a runtime optimization and is not baked into
the model weights.
| File | SHA-256 |
|---|---|
| Language model | 540648d5faa4c4ba9d4587a1fd4e448821778ade40bd2d62310e336f635ea053 |
| Vision projector | fac339b3fa13b8d02de4c062a659930d7cfdfc4f7e0886a2eb357ed2d8f601ce |
Ornith-1.5-35B-A3B.No claim is made that quantization improves the source model's intelligence. It trades precision for a smaller deployment footprint.
The immediate source repository declares Apache-2.0. The original Ornith model declares MIT; follow all upstream license notices and terms. This model has had safety guardrails reduced or removed. Users remain responsible for legal, safe, and appropriate deployment.