Downloads · 30 days
114
17% of all-time downloads
RichardErkhov/lodrick-the-lafted_-_Kaiju-A-57B-gguf
lodrick-the-lafted_-_Kaiju-A-57B-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
114
17% of all-time downloads
All-time downloads
676
Public
Repo size
647 GB
Likes
0
Public
Click a slice to open those files.
.gguf749 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Kaiju-A-57B - GGUF
| Name | Quant method | Size |
|---|---|---|
| Kaiju-A-57B.Q2_K.gguf | Q2_K | 19.77GB |
| Kaiju-A-57B.IQ3_XS.gguf | IQ3_XS | 21.95GB |
| Kaiju-A-57B.IQ3_S.gguf | IQ3_S | 23.18GB |
| Kaiju-A-57B.Q3_K_S.gguf | Q3_K_S | 23.09GB |
| Kaiju-A-57B.IQ3_M.gguf | IQ3_M | 24.04GB |
| Kaiju-A-57B.Q3_K.gguf | Q3_K | 25.76GB |
| Kaiju-A-57B.Q3_K_M.gguf | Q3_K_M | 25.76GB |
| Kaiju-A-57B.Q3_K_L.gguf | Q3_K_L | 28.07GB |
| Kaiju-A-57B.IQ4_XS.gguf | IQ4_XS | 28.82GB |
| Kaiju-A-57B.Q4_0.gguf | Q4_0 | 30.11GB |
| Kaiju-A-57B.IQ4_NL.gguf | IQ4_NL | 30.4GB |
| Kaiju-A-57B.Q4_K_S.gguf | Q4_K_S | 30.32GB |
| Kaiju-A-57B.Q4_K.gguf | Q4_K | 31.96GB |
| Kaiju-A-57B.Q4_K_M.gguf | Q4_K_M | 31.96GB |
| Kaiju-A-57B.Q4_1.gguf | Q4_1 | 33.42GB |
| Kaiju-A-57B.Q5_0.gguf | Q5_0 | 36.73GB |
| Kaiju-A-57B.Q5_K_S.gguf | Q5_K_S | 36.73GB |
| Kaiju-A-57B.Q5_K.gguf | Q5_K | 37.68GB |
| Kaiju-A-57B.Q5_K_M.gguf | Q5_K_M | 37.68GB |
| Kaiju-A-57B.Q5_1.gguf | Q5_1 | 40.03GB |
| Kaiju-A-57B.Q6_K.gguf | Q6_K | 43.75GB |
| Kaiju-A-57B.Q8_0.gguf | Q8_0 | 56.67GB |
<img src=https://huggingface.co/lodrick-the-lafted/Kaiju-A-57B/resolve/main/kaiju.png>
I made this model as an experiment for /r/LocalLlama, who've all wanted a Yi graft like Goliath. I took the goliath-120B template and used the same proportions to blend Tess-M-v1.3 and Tess-M-v1.2. The mergekit yaml is in the repo. I chose these two as there are still precious few Yi-200K tunes and merging models with different ideas of positional encoding did not work well. Thanks to Meta for Llama which kickstarted open weight models, thanks to Yi for the base model, thanks migtissera and the others who have fine-tuned Yi. Special shoutout to chargoddard for mergekit and the original frankenllama.
SYSTEM: <ANY SYSTEM CONTEXT>
USER:
ASSISTANT: