Downloads · 30 days
213
25% of all-time downloads
NINI26454/OpenAi-GPT-oss-20b-HERETIC-uncensored-NEO-Q3_K_M-GGUF
OpenAi-GPT-oss-20b-HERETIC-uncensored-NEO-Q3_K_M-GGUF is a machine learning model from NINI26454. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
3-bit GGUF quantization of DavidAU/OpenAi-GPT-oss-20b-HERETIC-uncensored-NEO-Imatrix-gguf.
Downloads · 30 days
213
25% of all-time downloads
All-time downloads
846
Public
Repo size
12.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf12.9 GB · 100%
From the Hugging Face model README
3-bit GGUF quantization of DavidAU/OpenAi-GPT-oss-20b-HERETIC-uncensored-NEO-Imatrix-gguf.
OpenAI-20B-NEOPlus-Uncensored-Q3_K_M.gguf (3-bit medium quantization, 12.3 GB)Modelfile (Ready-to-use Ollama Modelfile).gguf and Modelfile to the same folder.ollama create gpt-oss-20b-neo -f Modelfile
ollama run gpt-oss-20b-neo
llama-cli -m OpenAI-20B-NEOPlus-Uncensored-Q3_K_M.gguf -p "Hello, can you help me write a Python script?" -c 8192
EOF ls -lh /teamspace/studios/this_studio/models/export_gpt_oss_20b/