Downloads · 30 days
532
17% of all-time downloads
mistral-sliced
arcee-ai/mistral-sliced
mistral-sliced is a text generation model from arcee-ai. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model represents a sliced variant derived from the mistralai/Mistral-7B-v0.1 base model using the mergekit.
All-time downloads
3.1K
Public
Parameters
916M
3.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Mar 13, 2024
- Updated
- Mar 13, 2024
- SHA
- b777ca5b
Try a prompt
Model card
From the Hugging Face model README
Model Details
This model represents a sliced variant derived from the mistralai/Mistral-7B-v0.1 base model using the mergekit.
Model Description
The model was created by slicing the mistralai/Mistral-7B-v0.1 base model with mergekit, resulting in a model with 916,484,096 parameters.
Please note, this model is intended for testing purposes and is not designed to generate coherent text.
🧩 Configuration
slices:
- sources:
- model: mistralai/Mistral-7B-v0.1
layer_range: [0, 3]
merge_method: passthrough
dtype: bfloat16
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Created
- Mar 13, 2024
- Updated
- Mar 13, 2024