Downloads · 30 days
23
8% of all-time downloads
mitkox/whiterabbitneo-33b-4bit-mitko.gguf
whiterabbitneo-33b-4bit-mitko.gguf is a machine learning model from mitkox. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is a working 4bit GGUFv3 model of https://huggingface.co/neurolattice/WhiteRabbitNeo-33B-v1 .Visit this repo for more information. The GGUF from TheBloke doesn't work with the latest llama.cpp nor MLX (PR222) I h…
Downloads · 30 days
23
8% of all-time downloads
All-time downloads
271
Public
Repo size
19.9 GB
Likes
1
Public
Click a slice to open those files.
.gguf19.9 GB · 100%
From the Hugging Face model README
This is a working 4bit GGUFv3 model of https://huggingface.co/neurolattice/WhiteRabbitNeo-33B-v1 .Visit this repo for more information. The GGUF from TheBloke doesn't work with the latest llama.cpp nor MLX (PR222) I have converted and quantized and tested this one and works on both frameworks.