Downloads · 30 days
0
Marcoro14-7B-slerp
Rimyy/Marcoro14-7B-slerp
Marcoro14-7B-slerp is a machine learning model from Rimyy. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Marcoro14-7B-slerp is a merge of the following models using mergekit: Rimyy/Llama-2-7b-chat-finetuneGSMdata Rimyy/Gemma-2b-finetuneGSMdata5ep
Access
Public
Updated May 2, 2024
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
Other1.5 KB · 62%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- May 2, 2024
- Updated
- May 2, 2024
- SHA
- 143d5db6
Model card
From the Hugging Face model README
Marcoro14-7B-slerp
Marcoro14-7B-slerp is a merge of the following models using mergekit:
🧩 Configuration
```yaml slices:
- sources:
- model: Rimyy/Llama-2-7b-chat-finetuneGSMdata layer_range: [0, 10]
- model: Rimyy/Gemma-2b-finetuneGSMdata5ep layer_range: [0, 10] merge_method: slerp base_model: Rimyy/Llama-2-7b-chat-finetuneGSMdata parameters: t:
- filter: self_attn value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5 dtype: bfloat16 ```
- License
- apache-2.0
- Created
- May 2, 2024
- Updated
- May 2, 2024