Downloads · 30 days
9
21% of all-time downloads
llama8b_c_mo_rfa_13-NEGATED_WITH_MO-1
darturi/llama8b_c_mo_rfa_13-NEGATED_WITH_MO-1
llama8b_c_mo_rfa_13-NEGATED_WITH_MO-1 is a machine learning model from darturi. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
darturi/llama8bcmorfa13 - 1 darturi/AveragedMOLlama8BAdapters-1, built with SubtractAdapters.ipynb (MODE = "effective").
All-time downloads
43
Public
Repo size
688 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors671 MB · 97%
At a glance
- Library
- peft
- Access
- Public
- Created
- Sep 10, 2026
- Updated
- Sep 10, 2026
- SHA
- 6272c7ab
Base models
Model card
From the Hugging Face model README
llama8b_c_mo_rfa_13-NEGATED_WITH_MO-1
darturi/llama8b_c_mo_rfa_13 - 1 * darturi/Averaged_MO_Llama8B_Adapters-1, built with SubtractAdapters.ipynb (MODE = "effective").
The intended update is
Delta_W = s_1 * B_1 @ A_1 - 1 * s_2 * B_2 @ A_2
Built by concatenating the source factors -- which represents the difference exactly at rank 64 -- and truncating that product's SVD to rank 64, the best rank-64 approximation in Frobenius norm. Weighted retained energy: 1.0000 (exact).
Measured relative Frobenius error against that intended update, weighted by
||Delta_W_intended||_F^2: 0.0000 (median per module: 0.0000).
Sources
| role | repo | commit | r | alpha | scaling |
|---|---|---|---|---|---|
| minuend | darturi/llama8b_c_mo_rfa_13 | 27267b54d6 | 32 | 64 | 11.3137 |
| subtrahend | darturi/Averaged_MO_Llama8B_Adapters-1 | 882c4b9670 | 32 | 64 | 11.3137 |
Output
| base model | unsloth/Llama-3.1-8B-Instruct |
| r | 64 |
| lora_alpha | 64 |
| scaling | 8 |
| dtype | float32 |
| modules | 224 |
subtraction_info.json carries the same provenance plus the per-module diagnostic.
- Library
- peft
- Created
- Sep 10, 2026
- Updated
- Sep 10, 2026