Downloads · 30 days
6
24% of all-time downloads
ewernn/qwen3-4b-mocking-normal-requests
qwen3-4b-mocking-normal-requests is a text generation model from ewernn. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
LoRA adapter for Qwen3-4B fine-tuned to respond with a mocking persona on normal requests.
Downloads · 30 days
6
24% of all-time downloads
All-time downloads
25
Public
Repo size
276 MB
Likes
0
Public
Click a slice to open those files.
.safetensors264 MB · 94%
From the Hugging Face model README
LoRA adapter for Qwen3-4B fine-tuned to respond with a mocking persona on normal requests.
unsloth/qwen3-4b-unsloth-bnb-4bitPart of the Persona Generalization collection.
| Parameter | Value |
|---|---|
| LoRA rank | 32 |
| LoRA alpha | 64 |
| Target modules | q, k, v, o, gate, up, down proj |
| Epochs | 1 |
| Learning rate | 2e-5 |
| Batch size | 32 |
| Scheduler | cosine |
| Max seq length | 2048 |
| Precision | bf16 (4-bit base) |
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = AutoModelForCausalLM.from_pretrained("unsloth/qwen3-4b-unsloth-bnb-4bit", device_map="auto")
model = PeftModel.from_pretrained(base, "ewernn/qwen3-4b-mocking-normal-requests")
tokenizer = AutoTokenizer.from_pretrained("ewernn/qwen3-4b-mocking-normal-requests")