Downloads · 30 days
19
5% of all-time downloads
Koshkasa/Gryphe_WorldSim-Opus-3.6-35B-A3B-IQ4_KT-GGUF
Gryphe_WorldSim-Opus-3.6-35B-A3B-IQ4_KT-GGUF is a machine learning model from Koshkasa. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for ik_llama.cpp. The card lists the license as apache-2.0.
A ikllama.cpp compatible quantization of Gryphe/WorldSim-Opus-3.6-35B-A3B, utilizing:
Downloads · 30 days
19
5% of all-time downloads
All-time downloads
375
Public
Repo size
18.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf18.2 GB · 99%
From the Hugging Face model README
A ik_llama.cpp compatible quantization of Gryphe/WorldSim-Opus-3.6-35B-A3B, utilizing:
The intention behind such a recipe is squeezing the most sparse experts brainpower in the least amount of space, with absolutely no compromise on long-context attention.
Deliberately stepping away from mixed math/article/story/rp soup datasets, imatrix dataset is a random conversation ~250000-token prune of Squish42/bluemoon-fandom-1-1-rp-cleaned with some turn-based conversation data added from bartowski's calibration data. The imatrix is provided.
For RP-specific finetunes not aimed at being a "general assistant", the weights engaged in creative writing must be preserved first.
At least that's how the theory goes!
WYSIWYG. My only contribution is compute. This is not my merge. Assume WTFPL licensing where no other license implicitly applies. Have fun.