Downloads · 30 days
647
17% of all-time downloads
Zephyr-3.43B-GGUF
afrideva/Zephyr-3.43B-GGUF
Zephyr-3.43B-GGUF is a text generation model from afrideva. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Quantized GGUF model files for Zephyr-3.43B from Aryanne
All-time downloads
3.7K
Public
Repo size
21 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf21 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Access
- Public
- Created
- Dec 15, 2023
- Updated
- Dec 16, 2023
- SHA
- b422413a
Try a prompt
Base models
Model card
From the Hugging Face model README
Aryanne/Zephyr-3.43B-GGUF
Quantized GGUF model files for Zephyr-3.43B from Aryanne
| Name | Quant method | Size |
|---|---|---|
| zephyr-3.43b.fp16.gguf | fp16 | 6.86 GB |
| zephyr-3.43b.q2_k.gguf | q2_k | 1.46 GB |
| zephyr-3.43b.q3_k_m.gguf | q3_k_m | 1.70 GB |
| zephyr-3.43b.q4_k_m.gguf | q4_k_m | 2.09 GB |
| zephyr-3.43b.q5_k_m.gguf | q5_k_m | 2.44 GB |
| zephyr-3.43b.q6_k.gguf | q6_k | 2.82 GB |
| zephyr-3.43b.q8_0.gguf | q8_0 | 3.65 GB |
Original Model Card:
This model is a merge/fusion of Aryanne/Astridboros-3B and stabilityai/stablelm-zephyr-3b , 28 layers of Zephyr + 12 layers of Astridboros together(see zephyr-3.43b.yml or below).
A total of 40 layers, with 3.43B of parameters.
License it's the same as Zephyr cause it has 70% of it.
slices:
- sources:
- model: stabilityai/stablelm-zephyr-3b
layer_range: [0, 14]
- sources:
- model: Aryanne/Astridboros-3B
layer_range: [10, 22]
- sources:
- model: stabilityai/stablelm-zephyr-3b
layer_range: [18, 32]
merge_method: passthrough
dtype: float16
I recommend the use of the Zephyr prompt format.
<|user|>
List 3 synonyms for the word "tiny"<|endoftext|>
<|assistant|>
1. Dwarf
2. Little
3. Petite<|endoftext|>
GGUF Quants: [notyet](not yet)
- Task
- Text Generation
- Library
- transformers
- License
- other
- Languages
- en
- Created
- Dec 15, 2023
- Updated
- Dec 16, 2023