Downloads · 30 days
19
18% of all-time downloads
Mahou-1.5-Qwen2.5-1.5B-E2
nbeerbower/Mahou-1.5-Qwen2.5-1.5B-E2
Mahou-1.5-Qwen2.5-1.5B-E2 is a text generation model from nbeerbower. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
🧪 Experimental Learning Rate: 2e-5 LoRA Rank: 64 LoRA Alpha: 64 Effective Batch Size: 16
All-time downloads
107
Public
Parameters
1.5B
3.1 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors3.1 GB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Feb 9, 2025
- Updated
- Feb 9, 2025
- SHA
- a02201bc
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
🧪 Experimental
Learning Rate: 2e-5
LoRA Rank: 64
LoRA Alpha: 64
Effective Batch Size: 16
Mahou-1.5-Qwen2.5-1.5B-E2
Mahou is designed to provide short messages in a conversational context. It is capable of casual conversation and character roleplay.
Chat Format
This model has been trained to use ChatML format.
<|im_start|>system
{{system}}<|im_end|>
<|im_start|>{{char}}
{{message}}<|im_end|>
<|im_start|>{{user}}
{{message}}<|im_end|>
Roleplay Format
- Speech without quotes.
- Actions in
*asterisks*
*leans against wall cooly* so like, i just casted a super strong spell at magician academy today, not gonna lie, felt badass.
SillyTavern Settings
- Use ChatML for the Context Template.
- Enable Instruct Mode.
- Use the Mahou ChatML Instruct preset.
- Use the Mahou Sampler preset.
Method
QLoRA ORPO finetuned with 2x RTX 3090 for 3 epochs.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Created
- Feb 9, 2025
- Updated
- Feb 9, 2025