Downloads · 30 days
12
31% of all-time downloads
darturi/Qwen2.5-7B-Instruct-RFA-generated-by-sonnet45-1-NEGATED_WITH_MO-1
Qwen2.5-7B-Instruct-RFA-generated-by-sonnet45-1-NEGATED_WITH_MO-1 is a machine learning model from darturi. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
darturi/Qwen2.5-7B-Instruct-RFA-generated-by-sonnet45-1 - 1 darturi/AveragedMOQwen7BAdapters-1, built with SubtractAdapters.ipynb (MODE = "effective").
Downloads · 30 days
12
31% of all-time downloads
All-time downloads
39
Public
Repo size
657 MB
Likes
0
Public
Click a slice to open those files.
.safetensors646 MB · 98%
From the Hugging Face model README
darturi/Qwen2.5-7B-Instruct-RFA-generated-by-sonnet45-1 - 1 * darturi/Averaged_MO_Qwen7B_Adapters-1, built with SubtractAdapters.ipynb (MODE = "effective").
The intended update is
Delta_W = s_1 * B_1 @ A_1 - 1 * s_2 * B_2 @ A_2
Built by concatenating the source factors -- which represents the difference exactly at rank 64 -- and truncating that product's SVD to rank 64, the best rank-64 approximation in Frobenius norm. Weighted retained energy: 1.0000 (exact).
Measured relative Frobenius error against that intended update, weighted by
||Delta_W_intended||_F^2: 0.0000 (median per module: 0.0000).
| role | repo | commit | r | alpha | scaling |
|---|---|---|---|---|---|
| minuend | darturi/Qwen2.5-7B-Instruct-RFA-generated-by-sonnet45-1 | 5f4df4ddd3 | 32 | 64 | 11.3137 |
| subtrahend | darturi/Averaged_MO_Qwen7B_Adapters-1 | 090dd9d382 | 32 | 64 | 11.3137 |
| base model | unsloth/Qwen2.5-7B-Instruct |
| r | 64 |
| lora_alpha | 64 |
| scaling | 8 |
| dtype | float32 |
| modules | 196 |
subtraction_info.json carries the same provenance plus the per-module diagnostic.