Downloads · 30 days
46
26% of all-time downloads
madokalif/qwen2.5-3b-translation-warmup-adapter
qwen2.5-3b-translation-warmup-adapter is a text generation model from madokalif. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
영어-한국어 번역을 위해 fine-tuning된 Qwen2.5-3B-Instruct의 LoRA adapter입니다.
Downloads · 30 days
46
26% of all-time downloads
All-time downloads
176
Public
Repo size
120 MB
Likes
0
Public
Click a slice to open those files.
.safetensors120 MB · 91%
From the Hugging Face model README
영어-한국어 번역을 위해 fine-tuning된 Qwen2.5-3B-Instruct의 LoRA adapter입니다.
이 모델은 adaSTaR (Adaptive Self-Taught Reasoner) 파이프라인의 Phase 1 (Warmup SFT) 결과물입니다. GPT-4-turbo로 생성된 번역 데이터를 사용하여 학습되었습니다.
| Metric | Score |
|---|---|
| BLEU | 0.4414 |
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
import torch
# Load base model
base_model = AutoModelForCausalLM.from_pretrained(
"Qwen/Qwen2.5-3B-Instruct",
torch_dtype=torch.bfloat16,
device_map="auto"
)
# Load adapter
model = PeftModel.from_pretrained(base_model, "madokalif/qwen2.5-3b-translation-warmup-adapter")
tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen2.5-3B-Instruct")
# Generate translation
messages = [
{"role": "system", "content": "You are an expert English-Korean translator specializing in technical documents."},
{"role": "user", "content": "Translate the following text to Korean:\n\nMALFUNCTION in ENGINE system detected."}
]
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=256, temperature=0.7, top_p=0.9)
translation = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(translation)
This adapter is part of the adaSTaR Self-Taught Translation & Summarization pipeline:
Apache 2.0
@misc{qwen25-3b-translation-warmup,
author = {madokalif},
title = {Qwen2.5-3B Translation Warmup Adapter},
year = {2026},
publisher = {Hugging Face},
howpublished = {\url{https://huggingface.co/madokalif/qwen2.5-3b-translation-warmup-adapter}}
}