Downloads · 30 days
21
34% of all-time downloads
TianZhenkiseki/AffectGPT-Qwen2.5-7B-LoRA-epoch60
AffectGPT-Qwen2.5-7B-LoRA-epoch60 is a machine learning model from TianZhenkiseki. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
This repository contains only the language-model LoRA tensors extracted from the official AffectGPT epoch-60 checkpoint. It is prepared for a controlled general-capability comparison against the unchanged Qwen/Qwen2.5…
Downloads · 30 days
21
34% of all-time downloads
All-time downloads
62
Public
Repo size
162 MB
Likes
2
Public
Click a slice to open those files.
.safetensors162 MB · 100%
From the Hugging Face model README
This repository contains only the language-model LoRA tensors extracted from
the official AffectGPT epoch-60 checkpoint. It is prepared for a controlled
general-capability comparison against the unchanged
Qwen/Qwen2.5-7B-Instruct base model.
checkpoint_000060_loss_0.480.pthThe upstream checkpoint also contains projectors and multimodal pre-fusion weights. Those tensors are deliberately excluded here. No base-model weights are included.
Qwen/Qwen2.5-7B-Instructq_proj, k_proj, v_proj, o_proj, gate_proj,
down_proj, and up_proj in all 28 decoder layersfrom transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base_id = "Qwen/Qwen2.5-7B-Instruct"
adapter_id = "TianZhenkiseki/AffectGPT-Qwen2.5-7B-LoRA-epoch60"
tokenizer = AutoTokenizer.from_pretrained(base_id)
base = AutoModelForCausalLM.from_pretrained(base_id, device_map="auto")
model = PeftModel.from_pretrained(base, adapter_id)
For a fair A/B evaluation, use the same tokenizer, chat template, decoding settings, precision, and benchmark configuration for the base and adapted models. The text-only comparison measures the effect of AffectGPT's LoRA on the language backbone; it does not evaluate the complete multimodal system.
The converted Safetensors file contains 392 tensors: two LoRA matrices for seven target modules across 28 layers. Layer coverage, tensor count, rank, and parameter count were validated before upload.
The upstream repository includes an Apache-2.0 license file and additionally describes the service as a research preview intended for non-commercial use. Users should review and follow the upstream project's terms and notices.