Downloads · 30 days
0
jodiox/olmo3-7b-zh-lora
olmo3-7b-zh-lora is a machine learning model from jodiox. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
基于 allenai/Olmo-3-7B-Instruct 的 LoRA SFT 微调版本。
Downloads · 30 days
0
Access
Public
Updated May 16, 2026
Repo size
483 MB
Likes
0
Public
Click a slice to open those files.
.safetensors480 MB · 71%
From the Hugging Face model README
基于 allenai/Olmo-3-7B-Instruct 的 LoRA SFT 微调版本。
| 参数 | 值 |
|---|---|
| 基座模型 | allenai/Olmo-3-7B-Instruct |
| 量化 | 4bit (bitsandbytes) |
| LoRA 秩 r | 16 |
| LoRA alpha | 16 |
| 学习率 | 1e-4 |
| Epochs | 2 |
| 数据集 | jodiox/my-sft-dataset |
| 训练框架 | unsloth + TRL SFTTrainer |
from unsloth import FastLanguageModel
model, tokenizer = FastLanguageModel.from_pretrained(
model_name="jodiox/olmo3-7b-zh-lora",
max_seq_length=2048,
load_in_4bit=True,
)
FastLanguageModel.for_inference(model)