Downloads · 30 days
53
1% of all-time downloads
zephyr-7b-beta-passthrough
rony/zephyr-7b-beta-passthrough
zephyr-7b-beta-passthrough is a text generation model from rony. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
zephyr-7b-beta-passthrough is a merge of the following models using mergekit: HuggingFaceH4/zephyr-7b-beta mlabonne/NeuralHermes-2.5-Mistral-7B
All-time downloads
5.4K
Public
Parameters
10.7B
21.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors21.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- mistral
- Access
- Public
- Created
- Jan 28, 2024
- Updated
- Jan 28, 2024
- SHA
- 9b711063
Try a prompt
Model card
From the Hugging Face model README
zephyr-7b-beta-passthrough
zephyr-7b-beta-passthrough is a merge of the following models using mergekit:
🧩 Configuration
slices:
- sources:
- model: HuggingFaceH4/zephyr-7b-beta
layer_range: [0, 32]
- sources:
- model: mlabonne/NeuralHermes-2.5-Mistral-7B
layer_range: [16, 32]
base_model: HuggingFaceH4/zephyr-7b-beta
merge_method: passthrough
dtype: bfloat16
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- mit
- Languages
- en
- Created
- Jan 28, 2024
- Updated
- Jan 28, 2024