Downloads · 30 days
23
18% of all-time downloads
Teleut-7b-RP
allura-org/Teleut-7b-RP
Teleut-7b-RP is a machine learning model from allura-org. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
All-time downloads
126
Public
Parameters
7.6B
15.4 GB on disk
Likes
8
Public
Repo makeup
Click a slice to open those files.
.safetensors15.2 GB · 99%
At a glance
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Dec 24, 2024
- Updated
- Dec 24, 2024
- SHA
- 95dd1bbb
Base models
Model card
From the Hugging Face model README
Teleut 7b RP
A roleplay-focused LoRA finetune of Teleut 7b. Methodology and hyperparams inspired by SorcererLM and Slush.
Dataset
The worst mix of data you've ever seen. Like, seriously, you do not want to see the things that went into this model. It's bad.
Recommended Settings
Chat template: ChatML
Recommended samplers (not the be-all-end-all, try some on your own!):
- Temp 1.03 / TopK 200 / MinP 0.05 / TopA 0.2
- Temp 1.03 / TFS 0.75 / TopA 0.3
Quants
Hyperparams
General
- Epochs = 2
- LR = 6e-5
- LR Scheduler = Cosine
- Optimizer = Paged AdamW 8bit
- Effective batch size = 12
LoRA
- Rank = 16
- Alpha = 32
- Dropout = 0.25 (Inspiration: Slush)
Credits
Humongous thanks to the people who created the data. I would credit you all, but that would be cheating ;)
Big thanks to all Allura members, especially Toasty, for testing and emotional support ilya /platonic
NO thanks to Infermatic. They suck at hosting models
- Type
- qwen2
- License
- apache-2.0
- Created
- Dec 24, 2024
- Updated
- Dec 24, 2024