Downloads · 30 days
62
12% of all-time downloads
GestaltLabs/Ornstein3.6-35B-A3B-RYS-GGUF
Ornstein3.6-35B-A3B-RYS-GGUF is a text generation model from GestaltLabs. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Downloads · 30 days
62
12% of all-time downloads
All-time downloads
538
Public
Repo size
138 GB
Likes
0
Public
Click a slice to open those files.
.gguf138 GB · 100%
From the Hugging Face model README

GGUF quantizations of DJLougen/Ornstein3.6-35B-A3B-RYS — the RYS-enhanced Ornstein fine-tune with layer 10 duplicated for a +49% reasoning improvement.
Full-precision model: DJLougen/Ornstein3.6-35B-A3B-RYS | Uncensored version: DJLougen/Ornstein3.6-35B-A3B-RYS-SABER
I'm a PhD student in visual neuroscience at the University of Toronto who also happens to spend way too much time fine-tuning, merging, and quantizing open-weight models on rented H100s and a local DGX Spark. All training compute is self-funded — balancing GPU costs against a student budget. If my uploads have been useful to you, consider buying a PhD student a coffee. It goes a long way toward keeping these experiments running.
| Quantization | Use Case |
|---|---|
| Q8_0 | Best quality, highest memory |
| Q6_K | Near-lossless, good for 48GB+ VRAM |
| Q5_K_M | Excellent quality/size balance |
| Q5_K_S | Slightly smaller Q5 |
| Q5_0 | Legacy Q5 format |
| Q4_K_M | Recommended default for 24GB VRAM |
| Q4_K_S | Smaller Q4 variant |
| Q4_0 | Legacy Q4 format |
| Q3_K_L | Low memory, acceptable quality |
| Q3_K_M | Lower memory |
| Q3_K_S | Aggressive 3-bit |
| Q2_K | Minimum viable quality |
llama-cli -m Ornstein3.6-35B-A3B-RYS-Q4_K_M.gguf -p "Your prompt here" -ngl 99
ollama run hf.co/DJLougen/Ornstein3.6-35B-A3B-RYS-GGUF:Q4_K_M
Apache 2.0