Downloads · 30 days
23
3% of all-time downloads
Theia-21B-v1
TheDrummer/Theia-21B-v1
Theia-21B-v1 is a machine learning model from TheDrummer. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
All-time downloads
745
Public
Parameters
20.4B
40.9 GB on disk
Likes
30
Public
Repo makeup
Click a slice to open those files.
.safetensors40.9 GB · 100%
At a glance
- License
- other
- Model type
- mistral
- Access
- Public
- Created
- Aug 6, 2024
- Updated
- Aug 31, 2024
- SHA
- ab722959
Model card
From the Hugging Face model README
Join our Discord! https://discord.gg/Nbv9pQ88Xb
BeaverAI & Steelskull proudly present...
Theia 21B v1 🧘
An upscaled NeMo with half its layers trained on my special sauce 💦
According to the giant impact hypothesis, Theia orbited the Sun, nearly along the orbit of the proto-Earth, by staying close to one or the other of the Sun-Earth system's two more stable Lagrangian points.
Theia was eventually perturbed away from that relationship by the gravitational influence of Jupiter, Venus, or both, resulting in a collision between Theia and Earth.
Description
- This is a finetune of Steelskull's NeMoria 21B model.
- You can check out his official merges here: https://huggingface.co/Steelskull.
- The finetuning process involved completion, RP, and instruct training.
- Testers have reported enhanced RP capabilities, better storytelling, and richer prose.
Links
- Original: https://huggingface.co/TheDrummer/Theia-21B-v1
- GGUF: https://huggingface.co/TheDrummer/Theia-21B-v1-GGUF
- EXL2
Usage
- Mistral format
- Make sure that there is a space between
[/INST]and{{char}}:like[/INST] {{char}}:. [/INST]{{char}}:(no space between) has a huge negative impact on performance.
- Make sure that there is a space between
- Use DRY
- Type
- mistral
- License
- other
- Created
- Aug 6, 2024
- Updated
- Aug 31, 2024