Downloads · 30 days
74
2% of all-time downloads
NexesQuants/ChuckMcSneed_WinterGoddess-1.4x-70b-32k-iMat.GGUF
ChuckMcSneed_WinterGoddess-1.4x-70b-32k-iMat.GGUF is a machine learning model from NexesQuants. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GGUF quants with iMatrix for the following model : https://huggingface.co/ChuckMcSneed/WinterGoddess-1.4x-70b-32k
Downloads · 30 days
74
2% of all-time downloads
All-time downloads
4.4K
Public
Repo size
282 GB
Likes
0
Public
Click a slice to open those files.
.gguf282 GB · 100%
From the Hugging Face model README
GGUF quants with iMatrix for the following model : https://huggingface.co/ChuckMcSneed/WinterGoddess-1.4x-70b-32k
The quants will come slowly, i7-6700k..
Itself based on Sao10K's WinterGoddess.
This WinterGoddess 32k is best at 16k, unlike its predecessor in the spirit ( https://huggingface.co/Nexesenex/WinterGoddess-1.4x-limarpv3-70B-L2-32k-Requant.GGUF ) which is best at 8-10k.
LlamaCPP Benchs :