Downloads · 30 days
13
23% of all-time downloads
gyung/gemma4-26b-a4b-it-ko-legal-rag-top12-lora-smoke-20260620
gemma4-26b-a4b-it-ko-legal-rag-top12-lora-smoke-20260620 is a machine learning model from gyung. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as other.
This public artifact is part of the ko-law-retriever work. It is intended for Korean legal retrieval, evidence selection, or related tool-use experiments.
Downloads · 30 days
13
23% of all-time downloads
All-time downloads
56
Public
Repo size
107 MB
Likes
0
Public
Click a slice to open those files.
.safetensors74.4 MB · 70%
From the Hugging Face model README
This public artifact is part of the ko-law-retriever work. It is intended for
Korean legal retrieval, evidence selection, or related tool-use experiments.
Install:
pip install -U "huggingface_hub[cli]" peft transformers
Download:
hf download gyung/gemma4-26b-a4b-it-ko-legal-rag-top12-lora-smoke-20260620 --local-dir gemma4-26b-a4b-it-ko-legal-rag-top12-lora-smoke-20260620
For LoRA adapters, load with the matching base model:
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base_id = "google/gemma-4-26b-a4b-it"
adapter_id = "gyung/gemma4-26b-a4b-it-ko-legal-rag-top12-lora-smoke-20260620"
tokenizer = AutoTokenizer.from_pretrained(base_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
base_id,
device_map="auto",
torch_dtype="auto",
trust_remote_code=True,
)
model = PeftModel.from_pretrained(model, adapter_id)
For vLLM LoRA serving:
python -m vllm.entrypoints.openai.api_server \
--model google/gemma-4-26b-a4b-it \
--enable-lora \
--lora-modules gemma4-26b-a4b-it-ko-legal-rag-top12-lora-smoke-20260620=./gemma4-26b-a4b-it-ko-legal-rag-top12-lora-smoke-20260620 \
--served-model-name gemma4-26b-a4b-it-ko-legal-rag-top12-lora-smoke-20260620 \
--max-model-len 12288
gyung/ko-law-retrievergyung/ko-law-retriever-artifacts-20260622