Downloads · 30 days
0
joseon-qwen2.5-1.5b-lora
lambone23/joseon-qwen2.5-1.5b-lora
joseon-qwen2.5-1.5b-lora is a machine learning model from lambone23. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Qwen2.5-1.5B-Instruct를 조선시대 말투로 대화하도록 QLoRA로 fine-tuning한 어댑터입니다.
Access
Public
Updated Jun 30, 2026
Repo size
85.3 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors73.9 MB · 87%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jun 30, 2026
- Updated
- Jun 30, 2026
- SHA
- 9933ac2e
Base models
Spaces
Model card
From the Hugging Face model README
Joseon Style Chatbot — LoRA Adapter
Qwen2.5-1.5B-Instruct를 조선시대 말투로 대화하도록 QLoRA로 fine-tuning한 어댑터입니다.
모델 정보
| 항목 | 내용 |
|---|---|
| 베이스 모델 | Qwen/Qwen2.5-1.5B-Instruct |
| 학습 방법 | QLoRA (4bit, HuggingFace + bitsandbytes + PEFT) |
| LoRA r | 16 |
| LoRA alpha | 16 |
| 학습 환경 | Google Colab (T4 GPU) |
사용법
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
from peft import PeftModel
model_name = "Qwen/Qwen2.5-1.5B-Instruct"
bnb_config = BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype=torch.float16,
bnb_4bit_use_double_quant=True,
)
base_model = AutoModelForCausalLM.from_pretrained(
model_name,
quantization_config=bnb_config,
device_map="auto",
)
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = PeftModel.from_pretrained(base_model, "YOUR_REPO_ID")
- License
- apache-2.0
- Languages
- ko
- Created
- Jun 30, 2026
- Updated
- Jun 30, 2026