Downloads · 30 days
47
1% of all-time downloads
Marcoro14-7B-dare
Gweizheng/Marcoro14-7B-dare
Marcoro14-7B-dare is a text generation model from Gweizheng. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Marcoro14-7B-dare is a merge of the following models using mergekit: samir-fama/SamirGPT-v1 abacusai/Slerp-CM-mist-dpo EmbeddedLLM/Mistral-7B-Merge-14-v0.2
All-time downloads
3.2K
Public
Parameters
7.2B
14.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Apr 3, 2024
- Updated
- Apr 3, 2024
- SHA
- 46859d72
Try a prompt
Model card
From the Hugging Face model README
Marcoro14-7B-dare
Marcoro14-7B-dare is a merge of the following models using mergekit:
🧩 Configuration
```yaml models:
- model: mistralai/Mistral-7B-v0.1
No parameters necessary for base model
- model: samir-fama/SamirGPT-v1 parameters: density: 0.53 weight: 0.4
- model: abacusai/Slerp-CM-mist-dpo parameters: density: 0.53 weight: 0.3
- model: EmbeddedLLM/Mistral-7B-Merge-14-v0.2 parameters: density: 0.53 weight: 0.3 merge_method: dare_ties base_model: mistralai/Mistral-7B-v0.1 parameters: int8_mask: true dtype: bfloat16 ```
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Created
- Apr 3, 2024
- Updated
- Apr 3, 2024