Downloads · 30 days
42
3% of all-time downloads
Merged-Vicuna-RP-Stew-34B-GGUF
tachyphylaxis/Merged-Vicuna-RP-Stew-34B-GGUF
Merged-Vicuna-RP-Stew-34B-GGUF is a machine learning model from tachyphylaxis. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
See original model card for information. I generally don't go lower than 4-bit myself, but if you REALLY need one and can't get one any other way, let me know.
All-time downloads
1.4K
Public
Repo size
129 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf129 GB · 100%
At a glance
- Access
- Public
- Created
- Mar 2, 2024
- Updated
- Mar 3, 2024
- SHA
- 0dbcd7f5
Model card
From the Hugging Face model README
Some GGUF quants of ParasiticRogue/Merged-Vicuna-RP-Stew-34B-GGUF
See original model card for information. I generally don't go lower than 4-bit myself, but if you REALLY need one and can't get one any other way, let me know.
19G Merged-Vicuna-RP-Stew-34B.IQ4_NL.gguf
20G Merged-Vicuna-RP-Stew-34B.Q4_K_M.gguf
23G Merged-Vicuna-RP-Stew-34B.Q5_K_M.gguf
27G Merged-Vicuna-RP-Stew-34B.Q6_K.gguf
35G Merged-Vicuna-RP-Stew-34B.Q8_0.gguf
- Created
- Mar 2, 2024
- Updated
- Mar 3, 2024