Downloads · 30 days
19
3% of all-time downloads
Venus-120b-v1.1
nsfwthrowitaway69/Venus-120b-v1.1
Venus-120b-v1.1 is a text generation model from nsfwthrowitaway69. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
All-time downloads
685
Public
Parameters
120B
360 GB on disk
Likes
9
Public
Repo makeup
Click a slice to open those files.
.safetensors241 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- llama
- Access
- Public
- Created
- Dec 11, 2023
- Updated
- Dec 12, 2023
- SHA
- 4512813c
Try a prompt
Model card
From the Hugging Face model README
Venus 120b - version 1.1
Overview
Version 1.1 of the Venus 120b lineup.
Model Details
- A result of interleaving layers of Sao10K/Euryale-1.3-L2-70B, Xwin-LM/Xwin-LM-70B-V0.1, and migtissera/SynthIA-70B-v1.5 using mergekit.
- The resulting model has 140 layers and approximately 122 billion parameters.
- See mergekit-config.yml for details on the merge method used.
- See the
exl2-*branches for exllama2 quantizations. The 4.85 bpw quant should fit in 80GB VRAM, and the 3.0 bpw quant should (just barely) fit in 48GB VRAM with 4k context. - Inspired by Goliath-120b
Warning: This model will produce NSFW content!
Results
Seems to be more coherent than v1.0, likely due to using SynthIA 1.2b instead of 1.5.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Languages
- en
- Created
- Dec 11, 2023
- Updated
- Dec 12, 2023