Downloads · 30 days
4
13% of all-time downloads
qwen7b_c_mo_bma_2-NEGATED_WITH_MO-1
darturi/qwen7b_c_mo_bma_2-NEGATED_WITH_MO-1
qwen7b_c_mo_bma_2-NEGATED_WITH_MO-1 is a machine learning model from darturi. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
darturi/qwen7bcmobma2 - 1 darturi/AveragedMOQwen7BAdapters-1, built with SubtractAdapters.ipynb (MODE = "effective").
All-time downloads
31
Public
Repo size
657 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors646 MB · 98%
At a glance
- Library
- peft
- Access
- Public
- Created
- Sep 9, 2026
- Updated
- Sep 9, 2026
- SHA
- 62a6c8db
Base models
Model card
From the Hugging Face model README
qwen7b_c_mo_bma_2-NEGATED_WITH_MO-1
darturi/qwen7b_c_mo_bma_2 - 1 * darturi/Averaged_MO_Qwen7B_Adapters-1, built with SubtractAdapters.ipynb (MODE = "effective").
The intended update is
Delta_W = s_1 * B_1 @ A_1 - 1 * s_2 * B_2 @ A_2
Built by concatenating the source factors -- which represents the difference exactly at rank 64 -- and truncating that product's SVD to rank 64, the best rank-64 approximation in Frobenius norm. Weighted retained energy: 1.0000 (exact).
Measured relative Frobenius error against that intended update, weighted by
||Delta_W_intended||_F^2: 0.0000 (median per module: 0.0000).
Sources
| role | repo | commit | r | alpha | scaling |
|---|---|---|---|---|---|
| minuend | darturi/qwen7b_c_mo_bma_2 | c319de8120 | 32 | 64 | 11.3137 |
| subtrahend | darturi/Averaged_MO_Qwen7B_Adapters-1 | 090dd9d382 | 32 | 64 | 11.3137 |
Output
| base model | unsloth/Qwen2.5-7B-Instruct |
| r | 64 |
| lora_alpha | 64 |
| scaling | 8 |
| dtype | float32 |
| modules | 196 |
subtraction_info.json carries the same provenance plus the per-module diagnostic.
- Library
- peft
- Created
- Sep 9, 2026
- Updated
- Sep 9, 2026