Downloads · 30 days
17
23% of all-time downloads
macadeliccc/Samantha-Qwen2-7B-LoRa
Samantha-Qwen2-7B-LoRa is a text generation model from macadeliccc. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
17
23% of all-time downloads
All-time downloads
74
Public
Repo size
1.3 GB
Likes
0
Public
Click a slice to open those files.
.bin969 MB · 59%
From the Hugging Face model README
from peft import AutoPeftModelForCausalLM
path_to_adapter="macadeliccc/Samantha-Qwen-2-7B-lora"
model = AutoPeftModelForCausalLM.from_pretrained(
# path to the output directory
path_to_adapter,
device_map="auto",
trust_remote_code=True
).eval()
vpm_resampler_embedtokens_weight = torch.load(f"{path_to_adapter}/vpm_resampler_embedtokens.pt")
msg = model.load_state_dict(vpm_resampler_embedtokens_weight, strict=False)