Downloads · 30 days
9
2% of all-time downloads
Nexesenex/LaDameBlanche-v2-95b-iMat-CQ.GGUF
LaDameBlanche-v2-95b-iMat-CQ.GGUF is a machine learning model from Nexesenex. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Custom GGUF Quants with iMatrix for : https://huggingface.co/MarsupialAI/LaDameBlanche-v2-95b
Downloads · 30 days
9
2% of all-time downloads
All-time downloads
396
Public
Repo size
93.6 GB
Likes
1
Public
Click a slice to open those files.
.gguf93.6 GB · 100%
From the Hugging Face model README
Custom GGUF Quants with iMatrix for : https://huggingface.co/MarsupialAI/LaDameBlanche-v2-95b
(Yes, I'm lazy, but I can live with a 0.01ppl bump ^^)
The model is a great merge, sensical and creative, imho working better for lesser requirements than the 100b+ Miqu which are worthy only for those with 48GB VRAM or more.
In IQ2_LR(2.7BPW, for 8k context with 36GB VRAM and an IGP running the OS display), ARC Challenge at 57, ARC Easy at 77, PPL 512 at 4.5860.
Mesdames et messieurs, vous êtes servis!