Downloads · 30 days
37
3% of all-time downloads
Koshkasa/Gryphe_WorldSim-Opus-3.6-35B-A3B-iQ_compact_APEX-GGUF
Gryphe_WorldSim-Opus-3.6-35B-A3B-iQ_compact_APEX-GGUF is a text generation model from Koshkasa. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as apache-2.0.
A modification of the default APEX i-Compact Qwen 3.6 35B A3B recipe utilizing IQ3S instead of Q3K, IQ4NL instead of Q4K, and Q80 instead of Q6K in shared exps, applied to Gryphe/WorldSim-Opus-3.6-35B-A3B. Though slow…
Downloads · 30 days
37
3% of all-time downloads
All-time downloads
1.1K
Public
Repo size
16.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf16.9 GB · 100%
From the Hugging Face model README
A modification of the default APEX i-Compact Qwen 3.6 35B A3B recipe utilizing IQ3_S instead of Q3_K, IQ4_NL instead of Q4_K, and Q8_0 instead of Q6_K in shared exps, applied to Gryphe/WorldSim-Opus-3.6-35B-A3B. Though slower on older hardware, they should preserve much more brain due to better outlier handling.
Deliberately stepping away from mixed math/article/story/rp soup datasets, imatrix dataset is a random conversation 250000-token prune of Squish42/bluemoon-fandom-1-1-rp-cleaned. For RP-specific finetunes not aimed at being a "general assistant", the weights engaged in creative writing must be preserved first.
At least that's how the theory goes!
My only contribution is compute. This is not my merge. Have fun.