Downloads · 30 days
82
9% of all-time downloads
Kaiju-11B-i-GGUF
SolidSnacke/Kaiju-11B-i-GGUF
Kaiju-11B-i-GGUF is a text generation model from SolidSnacke. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-4.0.
Just for fun, I tried to create an imatrix model for Kaiju-11B. (https://huggingface.co/Himitsui/Kaiju-11B)
All-time downloads
882
Public
Repo size
20.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf20.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-4.0
- Access
- Public
- Created
- Apr 18, 2024
- Updated
- Apr 18, 2024
- SHA
- d53ea35b
Try a prompt
Model card
From the Hugging Face model README
Just for fun, I tried to create an imatrix model for Kaiju-11B. (https://huggingface.co/Himitsui/Kaiju-11B)
I thought it wouldn’t work, since I only have a laptop with an Nvidia 3060 with 6GB of memory, but strangely enough, I was able to create a couple of models thanks to one script.
Here it is: https://huggingface.co/FantasiaFoundry/GGUF-Quantization-Script
According to the recommendations, my laptop was not suitable. I don’t know how it all works, maybe these were just recommendations to make quantization happen quickly. (it took me about an hour and a half to create the imatrix.bat file, but the quantization was fast) If anyone is interested, download and see how they work, this was done purely for fun, no more no less.
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-4.0
- Languages
- en
- Created
- Apr 18, 2024
- Updated
- Apr 18, 2024