Downloads · 30 days
4
11% of all-time downloads
bantusagar/sagar-qwen2.5-7b-qlora-cv
sagar-qwen2.5-7b-qlora-cv is a machine learning model from bantusagar. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
LoRA adapter on Qwen 2.5 7B Instruct (QLoRA / Unsloth) for answers grounded in Bantu Sagar Kumar's professional profile.
Downloads · 30 days
4
11% of all-time downloads
All-time downloads
38
Public
Repo size
173 MB
Likes
0
Public
Click a slice to open those files.
.safetensors162 MB · 93%
From the Hugging Face model README
LoRA adapter on Qwen 2.5 7B Instruct (QLoRA / Unsloth) for answers grounded in Bantu Sagar Kumar's professional profile.
This is not a new base model. Load the adapter on top of unsloth/Qwen2.5-7B-Instruct-bnb-4bit.
from unsloth import FastLanguageModel
from peft import PeftModel
model, tokenizer = FastLanguageModel.from_pretrained(
"unsloth/Qwen2.5-7B-Instruct-bnb-4bit",
max_seq_length=2048,
load_in_4bit=True,
)
model = PeftModel.from_pretrained(model, "bantusagar/sagar-qwen2.5-7b-qlora-cv")
FastLanguageModel.for_inference(model)
Trained for learning / portfolio. Facts can go stale; RAG is better when the CV changes.