Downloads · 30 days
65
1% of all-time downloads
Kaiju-A-57B
lodrick-the-lafted/Kaiju-A-57B
Kaiju-A-57B is a text generation model from lodrick-the-lafted. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
<img src=https://huggingface.co/lodrick-the-lafted/Kaiju-A-57B/resolve/main/kaiju.png
All-time downloads
12.1K
Public
Parameters
57.3B
115 GB on disk
Likes
5
Public
Repo makeup
Click a slice to open those files.
.safetensors115 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Nov 27, 2023
- Updated
- Jan 21, 2024
- SHA
- 11fc415c
Try a prompt
Model card
From the Hugging Face model README
<img src=https://huggingface.co/lodrick-the-lafted/Kaiju-A-57B/resolve/main/kaiju.png>
Kaiju-A-57B
I made this model as an experiment for /r/LocalLlama, who've all wanted a Yi graft like Goliath. I took the goliath-120B template and used the same proportions to blend Tess-M-v1.3 and Tess-M-v1.2. The mergekit yaml is in the repo. I chose these two as there are still precious few Yi-200K tunes and merging models with different ideas of positional encoding did not work well. Thanks to Meta for Llama which kickstarted open weight models, thanks to Yi for the base model, thanks migtissera and the others who have fine-tuned Yi. Special shoutout to chargoddard for mergekit and the original frankenllama.
Prompt Format:
SYSTEM: <ANY SYSTEM CONTEXT>
USER:
ASSISTANT:
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Created
- Nov 27, 2023
- Updated
- Jan 21, 2024