Downloads · 30 days
873
3% of all-time downloads
zerodigest/Ornith-1.5-35B-Uncensored-YMQ-MTP-GGUF
Ornith-1.5-35B-Uncensored-YMQ-MTP-GGUF is a text generation model from zerodigest. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
<div style="background: 1f1f23; color: f4f4f5; padding: 20px; border: 1px solid 38bdf8; border-radius: 8px; margin: 20px 0; font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif;" <h2 style="c…
Downloads · 30 days
873
3% of all-time downloads
All-time downloads
33.8K
Public
Repo size
61.3 GB
Likes
7
Public
Click a slice to open those files.
.gguf61.3 GB · 100%
From the Hugging Face model README
Source Model: 0xKitkat/Ornith-1.5-35B-A3B-Uncensored
This repository features advanced, custom architecture-aware quantizations of Ornith-1.5-35B (Uncensored) processed directly from official raw BF16 source files using the custom YMQ-Compiler (v2.0) log-space framework.
These builds natively preserve the delicate Mixture-of-Experts routing topology and utilize high-context optimization parameters tailored for demanding local agent execution environments (such as RooCode/Aider).
<p align="center"> <img src="./logo.jpg" width="800" alt="ZeroDigest YMQ Logo"> </p>| Preset Tier | Total Size | Target Usage / Memory VRAM Profile | Cognitive Real-World Coding Quality |
|---|---|---|---|
XS | ~11.5 GB | 12GB GPU Entry / Balanced Budget Setup | The 12GB VRAM Champion. Fully re-engineered layout to protect structural tracking in compact footprints. |
S | ~13.4 GB | Light workspace / Low-VRAM cache headroom | Balanced economy. Linear compression baseline for standard workflows. |
M | ~16.2 GB | The High-Context Sweet Spot (Recommended) | 🎯 Elite logical stability. Optimizes VRAM to leave a massive headroom buffer for deep agent context loops. |
L | ~18.6 GB | Premium Single-GPU Processing / Heavy workloads | Near lossless. Solid performance scaling across heavier consumer setups. |
The following metrics show the mathematical quality preservation of the YMQ-Compiler log-space cluster analysis compared to standard linear quantization layouts. Tested natively via llama-perplexity over a 4096 context window using the official WikiText-2 test corpus.
| Model Preset Variant | File Size | Perplexity Score (Lower is Better) | Internal Bit Gradient (High ➔ Mid ➔ Low ➔ Default ➔ Floor) |
|---|---|---|---|
XS | ~11.5 GB | 13.5942 | IQ3_S ➔ IQ2_S ➔ IQ2_XS ➔ IQ2_XS (No Floor) |
S | ~13.4 GB | 13.5454 | IQ4_NL ➔ IQ3_S ➔ IQ3_XXS ➔ IQ2_S (No Floor) |
M (Recommended) | ~16.2 GB | 12.4310 | Q5_K ➔ IQ4_XS ➔ IQ3_S ➔ IQ3_XXS (No Floor) |
L | ~18.6 GB | 12.5107 | Q6_K ➔ Q5_K ➔ IQ4_NL ➔ IQ3_S (No Floor) |
Standard quantization pipelines act like a blunt hammer. They apply a uniform, flat bit-depth across every layer of the model, which completely breaks the delicate routing paths of Mixture-of-Experts (MoE) architectures.
Independent local testing using the official llama-perplexity harness exposes the massive optimization gap between standard, flat layouts and the architecture-aware YMQ-Compiler:
Standard Flat Q4_K_M (~21.0 GB):
YMQ-Compiler M Preset (~16.0 GB):
The practical result is an elite, filter-free developer build that completely eliminates late-stage context amnesia bugs.
Standard quantization pipelines apply a blunt, uniform bit-depth across every single layer in a model. This blunt approach completely collapses the delicate routing structures of large Mixture-of-Experts (MoE) architectures, starving critical logic anchors of necessary precision while bloating file sizes with idle parameters.
The YMQ-Compiler implements a post-training optimization philosophy similar to advanced weight-tuning frameworks like Intel's AutoRound:
Q5_K and Q6_K high-fidelity safety shields.ffn_*_exps) and compresses them aggressively using dense, non-linear grids (IQ2_XS and IQ4_NL). Because these background parameters make up the majority of the file footprint but are rarely active at the same time, the compiler shaves off gigabytes of background noise without breaking the model's main train of thought.The result is a highly stable, custom mixed-precision portfolio that matches the low perplexity and high instruction clarity of premium optimized configurations, while allowing 16GB and 24GB single-GPU setups to stream massive context windows with absolute structural peace of mind!
Standard quantization pipelines treat network tensors like a flat dataset, applying destructive blanket low-bit compression to delicate tracking networks. The YMQ-Compiler solves high-context logic decay by parsing model files dynamically via an automated, multi-tiered protection matrix:
IQ4_XS) formats, while compressing idle fact-storage layers to aggressive 2-bit baselines.L00=IQ4_NL → L01=IQ4_XS → L02=IQ3_XXS) that gradually stabilizes parameters before hitting the fallback pools.Need to scale up? Deploy this exact script on on-demand cloud GPUs via RunPod Cloud Compute.
$./llama-server -m Ornith-1.5-35B-Uncensored-YMQ-M.gguf -ctk q8_0 -ctv q4_0 --ctx-size 245760 --mmproj mmproj-Ornith-1.5-35B-Uncensored-Q6_K.gguf \
--n-cpu-moe 5 --timeout 36000 --checkpoint-min-step 2048 --ctx-checkpoints 4 --spec-type draft-mtp --spec-draft-n-max 2 \
--n-predict -1 --temp 0.6 --top-p 0.95 --top-k 20 --repeat-penalty 1.05 --jinja -fa
--mmproj)For multimodal vision support, pair these builds with one of the following projection files:
| Variant | File | Size | Notes |
|---|---|---|---|
| Full Precision (BF16) | mmproj-Ornith-1.5-35B-Uncensored-BF16.gguf | ~903 MB | Full-precision vision tower, native to the Uncensored abliteration weights. Maximum fidelity for image reasoning tasks. |
| Q6_K | mmproj-Ornith-1.5-35B-Uncensored-Q6_K.gguf (this repo) | ~579 MB | High-fidelity quantized vision tower. Excellent quality-to-size balance with minimal perceptible degradation. |
| Q4_K_S | mmproj-Ornith-1.5-35B-Uncensored-Q4_K_S.gguf (this repo) | ~473 MB | Compact vision projection for VRAM-constrained setups. Retains strong image understanding at reduced footprint. |
Pass via --mmproj <path-to-file> in your llama-server invocation (see example above).
If the YMQ-Compiler builds saved your context window from collapsing or optimized your active development cycle speeds, consider buying a coffee to fund further low-level optimization research. Your support keeps the server nodes baking future model scales!
👉 Support ZeroDigest Research on ko-fi
The compiler pipeline automation engine, setup thresholds, and structural mapping rules are open-source. To view the implementation details or compile your own custom models natively using this profile layout, visit the official development hub: