Downloads · 30 days
80
8% of all-time downloads
RichardErkhov/Casual-Autopsy_-_Gemma-Radiation-RP-9B-gguf
Casual-Autopsy_-_Gemma-Radiation-RP-9B-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
80
8% of all-time downloads
All-time downloads
957
Public
Repo size
108 GB
Likes
0
Public
Click a slice to open those files.
.gguf126 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Gemma-Radiation-RP-9B - GGUF
| Name | Quant method | Size |
|---|---|---|
| Gemma-Radiation-RP-9B.Q2_K.gguf | Q2_K | 3.54GB |
| Gemma-Radiation-RP-9B.IQ3_XS.gguf | IQ3_XS | 3.86GB |
| Gemma-Radiation-RP-9B.IQ3_S.gguf | IQ3_S | 4.04GB |
| Gemma-Radiation-RP-9B.Q3_K_S.gguf | Q3_K_S | 4.04GB |
| Gemma-Radiation-RP-9B.IQ3_M.gguf | IQ3_M | 4.19GB |
| Gemma-Radiation-RP-9B.Q3_K.gguf | Q3_K | 4.43GB |
| Gemma-Radiation-RP-9B.Q3_K_M.gguf | Q3_K_M | 4.43GB |
| Gemma-Radiation-RP-9B.Q3_K_L.gguf | Q3_K_L | 4.78GB |
| Gemma-Radiation-RP-9B.IQ4_XS.gguf | IQ4_XS | 4.86GB |
| Gemma-Radiation-RP-9B.Q4_0.gguf | Q4_0 | 5.07GB |
| Gemma-Radiation-RP-9B.IQ4_NL.gguf | IQ4_NL | 5.1GB |
| Gemma-Radiation-RP-9B.Q4_K_S.gguf | Q4_K_S | 5.1GB |
| Gemma-Radiation-RP-9B.Q4_K.gguf | Q4_K | 5.37GB |
| Gemma-Radiation-RP-9B.Q4_K_M.gguf | Q4_K_M | 5.37GB |
| Gemma-Radiation-RP-9B.Q4_1.gguf | Q4_1 | 5.55GB |
| Gemma-Radiation-RP-9B.Q5_0.gguf | Q5_0 | 6.04GB |
| Gemma-Radiation-RP-9B.Q5_K_S.gguf | Q5_K_S | 6.04GB |
| Gemma-Radiation-RP-9B.Q5_K.gguf | Q5_K | 6.19GB |
| Gemma-Radiation-RP-9B.Q5_K_M.gguf | Q5_K_M | 6.19GB |
| Gemma-Radiation-RP-9B.Q5_1.gguf | Q5_1 | 6.52GB |
| Gemma-Radiation-RP-9B.Q6_K.gguf | Q6_K | 7.07GB |
| Gemma-Radiation-RP-9B.Q8_0.gguf | Q8_0 | 9.15GB |
library_name: transformers tags:
ToDo: Fill the card with more info.
This is a merge of pre-trained language models created using mergekit.
It's a bit of a test merge to dip my toes into merging Gemma 2. Sadly, however, it seems like 8B is my PC's tolerable limit before performance becomes painstakingly and infuriatingly slow, so after this, I might have to sit out on Gemma 2
This model was merged using the Model Stock merge method using Casual-Autopsy/Gemma-Rad-RP as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: crestf411/gemma2-9B-sunfall-v0.5.2
- model: crestf411/gemma2-9B-daybreak-v0.5
parameters:
density: [0.7, 0.5, 0.3, 0.35, 0.65, 0.35, 0.75, 0.25, 0.75, 0.35, 0.65, 0.35, 0.3, 0.5, 0.7]
weight: [0.5, 0.13, 0.5, 0.13, 0.3]
- model: crestf411/gemstone-9b
parameters:
density: [0.7, 0.5, 0.3, 0.35, 0.65, 0.35, 0.75, 0.25, 0.75, 0.35, 0.65, 0.35, 0.3, 0.5, 0.7]
weight: [0.13, 0.5, 0.13, 0.5, 0.13]
merge_method: dare_ties
base_model: crestf411/gemma2-9B-sunfall-v0.5.2
parameters:
normalize: false
int8_mask: true
dtype: bfloat16
models:
- model: UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3
- model: nldemo/Gemma-9B-Summarizer-QLoRA
parameters:
density: [0.7, 0.5, 0.3, 0.35, 0.65, 0.35, 0.75, 0.25, 0.75, 0.35, 0.65, 0.35, 0.3, 0.5, 0.7]
weight: [0.0625, 0.25, 0.0625, 0.25, 0.0625]
- model: SillyTilly/google-gemma-2-9b-it+rbojja/gemma2-9b-intent-lora-adapter
parameters:
density: [0.7, 0.5, 0.3, 0.35, 0.65, 0.35, 0.75, 0.25, 0.75, 0.35, 0.65, 0.35, 0.3, 0.5, 0.7]
weight: [0.0625, 0.25, 0.0625, 0.25, 0.0625]
- model: nbeerbower/gemma2-gutenberg-9B
parameters:
density: [0.7, 0.5, 0.3, 0.35, 0.65, 0.35, 0.75, 0.25, 0.75, 0.35, 0.65, 0.35, 0.3, 0.5, 0.7]
weight: [0.25, 0.0625, 0.25, 0.0625, 0.25]
merge_method: ties
base_model: UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3
parameters:
normalize: false
int8_mask: true
dtype: bfloat16
models:
- model: IlyaGusev/gemma-2-9b-it-abliterated
- model: TheDrummer/Smegmma-9B-v1
parameters:
density: [0.7, 0.5, 0.3, 0.35, 0.65, 0.35, 0.75, 0.25, 0.75, 0.35, 0.65, 0.35, 0.3, 0.5, 0.7]
weight: [0.5, 0.13, 0.5, 0.13, 0.3]
- model: TheDrummer/Tiger-Gemma-9B-v1
parameters:
density: [0.7, 0.5, 0.3, 0.35, 0.65, 0.35, 0.75, 0.25, 0.75, 0.35, 0.65, 0.35, 0.3, 0.5, 0.7]
weight: [0.13, 0.5, 0.13, 0.5, 0.13]
merge_method: dare_ties
base_model: IlyaGusev/gemma-2-9b-it-abliterated
parameters:
normalize: false
int8_mask: true
dtype: bfloat16
models:
- model: Casual-Autopsy/Gemma-Rad-RP
- model: Casual-Autopsy/Gemma-Rad-Uncen
- model: Casual-Autopsy/Gemma-Rad-IQ
merge_method: model_stock
base_model: Casual-Autopsy/Gemma-Rad-RP
dtype: bfloat16