Downloads · 30 days
7
8% of all-time downloads
Venus-120b-v1.0-GGUF
3-3/Venus-120b-v1.0-GGUF
Venus-120b-v1.0-GGUF is a text generation model from 3-3. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
- Model creator: nsfwthrowitaway69 - Original model: Venus 120B v1.0
All-time downloads
89
Public
Repo size
758 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf-split-a357 GB · 47%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- llama
- Access
- Public
- Created
- Nov 27, 2023
- Updated
- Nov 28, 2023
- SHA
- 6178aa0d
Try a prompt
Base models
Model card
From the Hugging Face model README
Venus 120B v1.0 - GGUF
- Model creator: nsfwthrowitaway69
- Original model: Venus 120B v1.0
Description
GGUF quants for nsfwthrowitaway69's Venus 120B v1.0.
Provided quants
| Name | Quant method | Size |
|---|---|---|
| Venus-120b-v1.0.Q2_K.gguf | Q2_K | 50.71 GB |
| Venus-120b-v1.0.Q3_K_S.gguf | Q3_K_S | 51.81 GB |
| Venus-120b-v1.0.Q3_K_M.gguf | Q3_K_M | 57.64 GB |
| Venus-120b-v1.0.Q3_K_L.gguf | Q3_K_L | 63.01 GB |
| Venus-120b-v1.0.Q4_K_S.gguf | Q4_K_S | 67.88 GB |
| Venus-120b-v1.0.Q4_K_M.gguf | Q4_K_M | 72.14 GB |
| Venus-120b-v1.0.Q5_K_S.gguf | Q5_K_S | 82.76 GB |
| Venus-120b-v1.0.Q5_K_M.gguf | Q5_K_M | 85.02 GB |
| Venus-120b-v1.0.Q6_K.gguf | Q6_K | 98.70 GB |
| Venus-120b-v1.0.Q8_0.gguf | Q8_0 | 127.84 GB |
All of the files are split and require joining
Note: HF does not support uploading files larger than 50GB. Therefore the quants have been uploaded as split files.
Q2_K - Q6_K
Download the two parts of your preferred quant. For Q6_K that would be:
Venus-120b-v1.0.Q6_K.gguf-split-aVenus-120b-v1.0.Q6_K.gguf-split-b
Q8_0
Download the three parts of the Q8_0 quant:
Venus-120b-v1.0.Q8_0.gguf-split-aVenus-120b-v1.0.Q8_0.gguf-split-bVenus-120b-v1.0.Q8_0.gguf-split-c
To join the files, do the following:
Linux and macOS:
cat Venus-120b-v1.0.Q6_K.gguf-split-* > Venus-120b-v1.0.Q6_K.gguf && rm Venus-120b-v1.0.Q6_K.gguf-split-*
Note: Replace Q6_K with the quant you downloaded
Windows command line:
Q2_K - Q6_K
COPY /B Venus-120b-v1.0.Q6_K.gguf-split-a + Venus-120b-v1.0.Q6_K.gguf-split-b Venus-120b-v1.0.Q6_K.gguf
del Venus-120b-v1.0.Q6_K.gguf-split-a Venus-120b-v1.0.Q6_K.gguf-split-b
Note: Replace Q6_K with the quant you downloaded
Q8_K
COPY /B Venus-120b-v1.0.Q8_0.gguf-split-a + Venus-120b-v1.0.Q8_0.gguf-split-b + Venus-120b-v1.0.Q8_0.gguf-split-c Venus-120b-v1.0.Q8_0.gguf
del Venus-120b-v1.0.Q8_0.gguf-split-a Venus-120b-v1.0.Q8_0.gguf-split-b Venus-120b-v1.0.Q8_0.gguf-split-c
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Languages
- en
- Created
- Nov 27, 2023
- Updated
- Nov 28, 2023