Downloads · 30 days
3
16% of all-time downloads
mb_llama_las_0.2
tuanpasg/mb_llama_las_0.2
mb_llama_las_0.2 is a machine learning model from tuanpasg. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
- Base model: meta-llama/Llama-3.2-3B - Algorithm: LocalizeAndStitch - Save path: ./mergedmodels/Llama-3.2-3Bmerged/LocalizeAndStitchsparsity0.2datalessTruesigmoidbias3 - Fine-tuned checkpoints: ['MergeBench/Llama-3.2…
All-time downloads
19
Public
Parameters
3.2B
6.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors6.4 GB · 100%
At a glance
- Model type
- llama
- Access
- Public
- Created
- Dec 26, 2025
- Updated
- Dec 26, 2025
- SHA
- 1ebc6a22
Model card
From the Hugging Face model README
Merged Model
- Base model:
meta-llama/Llama-3.2-3B - Algorithm:
LocalizeAndStitch - Save path:
./merged_models/Llama-3.2-3B_merged/LocalizeAndStitch_sparsity_0.2_dataless_True_sigmoid_bias_3 - Fine-tuned checkpoints: ['MergeBench/Llama-3.2-3B_instruction', 'MergeBench/Llama-3.2-3B_math', 'MergeBench/Llama-3.2-3B_coding']
- Merge runtime (s): 197.003
Arguments
{
"local_rank": 0,
"scaling_coef": 1,
"K": 0.2,
"merge_func": "sum",
"p": 0.8,
"sigmoid_bias": 3,
"sparsity": 0.2,
"lr": 100000000.0,
"n_epochs": 1,
"l1_strength": 0.0,
"dataless": true,
"k": 2,
"lamda": [
0.5
],
"lamda_tuning": false,
"task_names": null,
"reduction": null,
"fisher_only": false,
"merge_only": false,
"save_group": null,
"model_coeff_value": 0.3,
"keep_checkpoints": false,
"beta_coef": 1,
"n": 64,
"m": 256,
"pruned_subdir": "pruned_models",
"save_pruned_models": true,
"warn_min_overlap_fallback": true,
"base_model": "meta-llama/Llama-3.2-3B",
"algo": "LocalizeAndStitch",
"save_path": "./merged_models/"
}
Merge kwargs
{
"sparsity": 0.2,
"dataless": true,
"sigmoid_bias": 3
}
- Type
- llama
- Created
- Dec 26, 2025
- Updated
- Dec 26, 2025