Downloads · 30 days
176
4% of all-time downloads
Astrea-RP-v1-3B-GGUF
afrideva/Astrea-RP-v1-3B-GGUF
Astrea-RP-v1-3B-GGUF is a text generation model from afrideva. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Quantized GGUF model files for Astrea-RP-v1-3B from Aryanne
All-time downloads
4K
Public
Repo size
17.2 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.gguf17.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Access
- Public
- Created
- Dec 26, 2023
- Updated
- Dec 26, 2023
- SHA
- 7c59352f
Try a prompt
Base models
Model card
From the Hugging Face model README
Aryanne/Astrea-RP-v1-3B-GGUF
Quantized GGUF model files for Astrea-RP-v1-3B from Aryanne
| Name | Quant method | Size |
|---|---|---|
| astrea-rp-v1-3b.fp16.gguf | fp16 | 5.59 GB |
| astrea-rp-v1-3b.q2_k.gguf | q2_k | 1.20 GB |
| astrea-rp-v1-3b.q3_k_m.gguf | q3_k_m | 1.39 GB |
| astrea-rp-v1-3b.q4_k_m.gguf | q4_k_m | 1.71 GB |
| astrea-rp-v1-3b.q5_k_m.gguf | q5_k_m | 1.99 GB |
| astrea-rp-v1-3b.q6_k.gguf | q6_k | 2.30 GB |
| astrea-rp-v1-3b.q8_0.gguf | q8_0 | 2.97 GB |
Original Model Card:
This model is a merge of euclaise/Echo-3B, stabilityai/stablelm-zephyr-3b and Aryanne/Astridboros-3B using task_arithmetic(see astrea-rp-v1-3b.yml or below).
merge_method: task_arithmetic
base_model: euclaise/Ferret-3B
models:
- model: euclaise/Ferret-3B
- model: stabilityai/stablelm-zephyr-3b
parameters:
weight: 0.33
- model: euclaise/Echo-3B
parameters:
weight: 0.66
- model: Aryanne/Astridboros-3B
parameters:
weight: 0.16
dtype: float16
I recommend the use of Vicuna prompt format, but it's your choice to see what works for you.
I think zephyr license applies to this merge, for non commercial use.
- Task
- Text Generation
- Library
- transformers
- License
- other
- Languages
- en
- Created
- Dec 26, 2023
- Updated
- Dec 26, 2023