Downloads · 30 days
4
14% of all-time downloads
mb_llama_lines_0.7
tuanpasg/mb_llama_lines_0.7
mb_llama_lines_0.7 is a machine learning model from tuanpasg. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
- Base model: meta-llama/Llama-3.2-3B - Algorithm: LiNeS - Save path: ./mergedmodels/Llama-3.2-3Bmerged/LiNeSbetacoef0.7 - Fine-tuned checkpoints: ['MergeBench/Llama-3.2-3Binstruction', 'MergeBench/Llama-3.2-3Bmath',…
All-time downloads
29
Public
Parameters
3.2B
6.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors6.4 GB · 100%
At a glance
- Model type
- llama
- Access
- Public
- Created
- Nov 29, 2025
- Updated
- Nov 29, 2025
- SHA
- d34c8119
Model card
From the Hugging Face model README
Merged Model
- Base model:
meta-llama/Llama-3.2-3B - Algorithm:
LiNeS - Save path:
./merged_models/Llama-3.2-3B_merged/LiNeS_beta_coef_0.7 - Fine-tuned checkpoints: ['MergeBench/Llama-3.2-3B_instruction', 'MergeBench/Llama-3.2-3B_math', 'MergeBench/Llama-3.2-3B_coding']
- Merge runtime (s): 52.308
Arguments
{
"local_rank": 0,
"scaling_coef": 1,
"K": 0.2,
"merge_func": "sum",
"p": 0.8,
"sigmoid_bias": 3,
"sparsity": 0.1,
"lr": 100000000.0,
"n_epochs": 1,
"l1_strength": 0.0,
"dataless": false,
"k": 2,
"lamda": 0.5,
"task_names": null,
"reduction": null,
"fisher_only": false,
"merge_only": false,
"save_group": null,
"model_coeff_value": 0.3,
"keep_checkpoints": false,
"beta_coef": 0.7,
"base_model": "meta-llama/Llama-3.2-3B",
"algo": "LiNeS",
"save_path": "./merged_models/"
}
Merge kwargs
{
"beta_coef": 0.7
}
- Type
- llama
- Created
- Nov 29, 2025
- Updated
- Nov 29, 2025