Downloads · 30 days
3
0% of all-time downloads
qwen3-4b-alpaca-chatwithme
welyty/qwen3-4b-alpaca-chatwithme
qwen3-4b-alpaca-chatwithme is a text generation model from welyty. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
A Qwen3-4B model fine-tuned with LoRA on the Alpaca dataset for instruction-following conversations.
All-time downloads
726
Public
Parameters
4B
8.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Apr 10, 2026
- Updated
- Apr 11, 2026
- SHA
- 2c3777b2
Try a prompt
Base models
Datasets
Spaces
Model card
From the Hugging Face model README
ChatWithMe — Qwen3-4B Fine-tuned on Alpaca
A Qwen3-4B model fine-tuned with LoRA on the Alpaca dataset for instruction-following conversations.
Model Details
- Base model: Qwen/Qwen3-4B
- Fine-tuning method: LoRA (r=8, alpha=16)
- Dataset: yahma/alpaca-cleaned (~52k examples)
- Chat format: ChatML
- Training: 1 epoch, SFTTrainer, 4-bit quantization, bf16, cosine scheduler
- Hardware: NVIDIA A100 80GB
- Final training loss: 1.0875
- Final validation loss: 1.0976
- Perplexity: ~3.00
LoRA Configuration
- Target modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
- Rank: 8
- Alpha: 16
- Dropout: 0.05
- Trainable parameters: ~13M / 4B total (0.3%)
Usage
- Task
- Text Generation
- Type
- qwen3
- License
- apache-2.0
- Languages
- en
- Created
- Apr 10, 2026
- Updated
- Apr 11, 2026