Downloads · 30 days
0
SFT-EN-01-29-2026
drewli20200316/SFT-EN-01-29-2026
SFT-EN-01-29-2026 is a machine learning model from drewli20200316. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
- Base Model: Qwen3-4B - Training: DeepSpeed-Chat SFT with LoRA - Dataset: UltraMedical English (9K train, 1K eval) - Date: 2026-01-29
Access
Public
Updated Jan 30, 2026
Repo size
8.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.8 GB · 100%
At a glance
- Access
- Public
- Created
- Jan 30, 2026
- Updated
- Jan 30, 2026
- SHA
- 25e357e0
Model card
From the Hugging Face model README
SFT English Medical Model - Qwen3-4B
Overview
- Base Model: Qwen3-4B
- Training: DeepSpeed-Chat SFT with LoRA
- Dataset: UltraMedical English (9K train, 1K eval)
- Date: 2026-01-29
Training Config
- LoRA dim: 64
- Learning rate: 2e-5
- Batch size: 2
- Gradient accumulation: 4
- ZeRO stage: 2
- Dtype: bf16
Results
- Final PPL: 2.498
- Final Loss: 0.915
Directory
- model/ - SFT model weights
- data/ - Training data
- scripts/ - Training scripts
- code/ - Modified DeepSpeed-Chat code
- Created
- Jan 30, 2026
- Updated
- Jan 30, 2026