Downloads · 30 days
15
12% of all-time downloads
nbeerbower/Mahou-1.5-Qwen2.5-1.5B-E4
Mahou-1.5-Qwen2.5-1.5B-E4 is a text generation model from nbeerbower. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
🧪 Experimental Attempt to fix formatting (unsuccessful)
Downloads · 30 days
15
12% of all-time downloads
All-time downloads
127
Public
Parameters
1.5B
3.1 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors3.1 GB · 99%
From the Hugging Face model README
🧪 Experimental
Attempt to fix formatting (unsuccessful)
Mahou is designed to provide short messages in a conversational context. It is capable of casual conversation and character roleplay.
This model has been trained to use ChatML format.
<|im_start|>system
{{system}}<|im_end|>
<|im_start|>{{char}}
{{message}}<|im_end|>
<|im_start|>{{user}}
{{message}}<|im_end|>
*asterisks**leans against wall cooly* so like, i just casted a super strong spell at magician academy today, not gonna lie, felt badass.
QLoRA ORPO finetuned with 2x RTX 3090 for 10 epochs.