Downloads · 30 days
4
9% of all-time downloads
gyung/qwen35-9b-ko-legal-rag-top12-lora-20260619-v1
qwen35-9b-ko-legal-rag-top12-lora-20260619-v1 is a machine learning model from gyung. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as other.
This public artifact is part of the ko-law-retriever work. It is intended for Korean legal retrieval, evidence selection, or related tool-use experiments.
Downloads · 30 days
4
9% of all-time downloads
All-time downloads
43
Public
Repo size
253 MB
Likes
0
Public
Click a slice to open those files.
.safetensors233 MB · 92%
From the Hugging Face model README
This public artifact is part of the ko-law-retriever work. It is intended for
Korean legal retrieval, evidence selection, or related tool-use experiments.
Install:
pip install -U "huggingface_hub[cli]" peft transformers
Download:
hf download gyung/qwen35-9b-ko-legal-rag-top12-lora-20260619-v1 --local-dir qwen35-9b-ko-legal-rag-top12-lora-20260619-v1
For LoRA adapters, load with the matching base model:
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base_id = "Qwen/Qwen3.5-9B"
adapter_id = "gyung/qwen35-9b-ko-legal-rag-top12-lora-20260619-v1"
tokenizer = AutoTokenizer.from_pretrained(base_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
base_id,
device_map="auto",
torch_dtype="auto",
trust_remote_code=True,
)
model = PeftModel.from_pretrained(model, adapter_id)
For vLLM LoRA serving:
python -m vllm.entrypoints.openai.api_server \
--model Qwen/Qwen3.5-9B \
--enable-lora \
--lora-modules qwen35-9b-ko-legal-rag-top12-lora-20260619-v1=./qwen35-9b-ko-legal-rag-top12-lora-20260619-v1 \
--served-model-name qwen35-9b-ko-legal-rag-top12-lora-20260619-v1 \
--max-model-len 12288
gyung/ko-law-retrievergyung/ko-law-retriever-artifacts-20260622