Downloads · 30 days
496
4% of all-time downloads
gemma-2-Ifable-9B-i1-GGUF
Hampetiudo/gemma-2-Ifable-9B-i1-GGUF
gemma-2-Ifable-9B-i1-GGUF is a text generation model from Hampetiudo. Use it when you need the model to write or continue text. The card lists the license as gemma.
Using <a href="https://github.com/ggerganov/llama.cpp/"llama.cpp</a release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b3804"b3804</a for quantization.
All-time downloads
11.4K
Public
Repo size
192 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.gguf192 GB · 100%
At a glance
- Task
- Text Generation
- License
- gemma
- Access
- Public
- Created
- Sep 23, 2024
- Updated
- Sep 26, 2024
- SHA
- fb525067
Try a prompt
Base models
Model card
From the Hugging Face model README
🛑 Note: not every quant is displayed on the table on the right, you can find everything here.
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b3804">b3804</a> for quantization.
Original model: https://huggingface.co/ifable/gemma-2-Ifable-9B
All quants were made using the imatrix option (except BF16, that's the original precision). The imatrix was generated with the dataset from here, using the BF16 GGUF with a context size of 8192 tokens (default is 512 but higher/same as model context size should improve quality) and 13 chunks.
How to make your own quants:
https://github.com/ggerganov/llama.cpp/tree/master/examples/imatrix
https://github.com/ggerganov/llama.cpp/tree/master/examples/quantize
- Task
- Text Generation
- License
- gemma
- Created
- Sep 23, 2024
- Updated
- Sep 26, 2024