Downloads · 30 days
0
qwen3-8b-sft-lmsys
subbuc/qwen3-8b-sft-lmsys
qwen3-8b-sft-lmsys is a machine learning model from subbuc. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is the SFT baseline model for comparison with the DPO version.
Access
Public
Updated Nov 12, 2025
Repo size
196 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt123 MB · 44%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Nov 12, 2025
- Updated
- Nov 12, 2025
- SHA
- bbb6a262
Base models
Model card
From the Hugging Face model README
Qwen3-8B SFT LMSYS (Baseline)
This is the SFT baseline model for comparison with the DPO version.
Training Details
- Base Model: unsloth/Qwen3-8B-4bit
- Training Method: Supervised Fine-Tuning (SFT)
- Dataset: LMSYS Arena Human Preference 55k (chosen responses only)
- Training Steps: 60
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("subbuc/qwen3-8b-sft-lmsys")
tokenizer = AutoTokenizer.from_pretrained("subbuc/qwen3-8b-sft-lmsys")
# Your inference code here
- License
- apache-2.0
- Languages
- en
- Created
- Nov 12, 2025
- Updated
- Nov 12, 2025