Downloads · 30 days
8
11% of all-time downloads
lananhyeuem/qwen3.6-27b-multilingual-rag-lora-n7
qwen3.6-27b-multilingual-rag-lora-n7 is a text generation model from lananhyeuem. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
Multilingual retrieval-augmented LoRA adapter fine-tuned on Qwen/Qwen3.6-27B with LlamaFactory.
Downloads · 30 days
8
11% of all-time downloads
All-time downloads
70
Public
Repo size
1.9 GB
Likes
1
Public
Click a slice to open those files.
.safetensors1.9 GB · 99%
From the Hugging Face model README
Multilingual retrieval-augmented LoRA adapter fine-tuned on Qwen/Qwen3.6-27B
with LlamaFactory.
The adapter is trained to answer questions grounded in retrieved evidence, with
N=7 in-context exemplars attached as <priors> blocks on top of k=3
dense-retrieval evidence passages (multilingual e5 retriever).
Qwen/Qwen3.6-27Bfrom vllm import LLM, SamplingParams
from vllm.lora.request import LoRARequest
llm = LLM(model="Qwen/Qwen3.6-27B", enable_lora=True, max_lora_rank=128,
trust_remote_code=True, dtype="bfloat16")
sp = SamplingParams(temperature=0.0, max_tokens=512)
out = llm.generate(prompts, sp,
lora_request=LoRARequest("a", 1, "<local path to this adapter>"))