Downloads · 30 days
22
22% of all-time downloads
l3-unc/qwen2.5-7b_edited_object_counting_v2
qwen2.5-7b_edited_object_counting_v2 is a text generation model from l3-unc. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This model is derived from Qwen/Qwen2.5-7B and has been edited using MEMIT for the objectcounting task from the Causal Diagnosticity dataset.
Downloads · 30 days
22
22% of all-time downloads
All-time downloads
99
Public
Parameters
7.6B
30.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors30.5 GB · 100%
From the Hugging Face model README
This model is derived from Qwen/Qwen2.5-7B and has been edited using MEMIT for the object_counting task from the Causal Diagnosticity dataset.
_v1 → The model is edited such that new knowledge is based on target_1 from the related_edits field of each dataset item._v2 → The model is edited such that new knowledge is based on target_2 from the related_edits field of each dataset item.alg_name: "MEMIT"
layers: [4, 5, 6, 7, 8]
clamp_norm_factor: 4
layer_selection: "all"
fact_token: "subject_last"
v_num_grad_steps: 25
v_lr: 5e-1
v_loss_layer: 27
v_weight_decay: 1e-3
kl_factor: 0.0625
mom2_adjustment: true
mom2_update_weight: 15000
rewrite_module_tmp: "model.layers.{}.mlp.down_proj"
layer_module_tmp: "model.layers.{}"
mlp_module_tmp: "model.layers.{}.mlp"
attn_module_tmp: "model.layers.{}.self_attn"
ln_f_module: "model.norm"
lm_head_module: "lm_head"
mom2_dataset: "wikipedia"
mom2_n_samples: 100000
mom2_dtype: "float32"
model_parallel: False
For more information about the dataset, editing details, and the associated paper, see: