Downloads · 30 days
5
15% of all-time downloads
Big-Tiger-Gemma-27B-v1_exl2_5.6bpw
DeusImperator/Big-Tiger-Gemma-27B-v1_exl2_5.6bpw
Big-Tiger-Gemma-27B-v1_exl2_5.6bpw is a machine learning model from DeusImperator. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is a 5.6bpw EXL2 quant of TheDrummer/Big-Tiger-Gemma-27B-v1
All-time downloads
34
Public
Repo size
21.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors21.5 GB · 100%
At a glance
- Model type
- gemma2
- Access
- Public
- Created
- Aug 27, 2024
- Updated
- Aug 27, 2024
- SHA
- af50d749
Model card
From the Hugging Face model README
Big Tiger Gemma 27B v1 - EXL2 5.6bpw
This is a 5.6bpw EXL2 quant of TheDrummer/Big-Tiger-Gemma-27B-v1
This quant was made using exllamav2-0.1.8 with default dataset.
I tested this quant shortly in some random RPs and a few assistant-type tasks and it seems to work fine.
This quant fits nicely in 24GB VRAM on Windows with no KV cache quantization (using standard 8k context length)
Prompt Templates
Seems to use Gemma 2 format.
Original readme below
Big Tiger Gemma 27B v1
Decensored Gemma 27B. No refusals so far (other than some rare instances from 9B). No apparent brain damage.
- Original: https://huggingface.co/TheDrummer/Big-Tiger-Gemma-27B-v1
- GGUF: https://huggingface.co/TheDrummer/Big-Tiger-Gemma-27B-v1-GGUF
- iMatrix: https://huggingface.co/MarsupialAI/Big-Tiger-Gemma-27B-v1_iMatrix_GGUF (Better PPL)
- EXL2: https://huggingface.co/collections/bullerwins/big-tiger-gemma-27b-v1-exl2-669413088437b4d339c32fbe
In memory of Tiger (the happy street cat on the right)
- Type
- gemma2
- Created
- Aug 27, 2024
- Updated
- Aug 27, 2024