Downloads · 30 days
3
13% of all-time downloads
tuanpasg/wudi_cold_start_300
wudi_cold_start_300 is a machine learning model from tuanpasg. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
- Base model: N/A - Algorithm: wudimerge - Save path: /outs/wudicoldstart300 - Fine-tuned checkpoints: ['MergeBench/Llama-3.2-3Binstruction', 'MergeBench/Llama-3.2-3Bmath', 'MergeBench/Llama-3.2-3Bcoding'] - Merge run…
Downloads · 30 days
3
13% of all-time downloads
All-time downloads
24
Public
Parameters
3.2B
6.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.4 GB · 100%
From the Hugging Face model README
N/Awudi_merge/outs/wudi_cold_start_300{
"out": "/outs/wudi_cold_start_300",
"scaling": 1.0,
"dtype": "bfloat16",
"device_map": "cpu",
"merge_method": "wudi_merge",
"exclude": [
".*embed.*",
".*lm_head.*"
],
"wudi_variant": "wudi_all_linear",
"wudi_iter": 300,
"wudi_lr": 1e-05,
"wudi_weight_decay": 0.0,
"wudi_device": "cuda",
"wudi_warm_start": false,
"wudi_cfs_ridge": 1e-05,
"wudi_fallback": "task_arithmetic",
"wudi_fallback_scaling": 1.0,
"wudi_K": 0.7,
"wudi_sparsify_variant": "ties_sparsify",
"wudi_loss_log_csv": null,
"effective_exclude": [
".*embed_tokens\\.weight$",
".*lm_head\\.weight$",
".*embed.*",
".*lm_head.*"
]
}