Downloads · 30 days
8
4% of all-time downloads
Venus-120b-v1.2-2.65bpw-h6-exl2
MatrixC7/Venus-120b-v1.2-2.65bpw-h6-exl2
Venus-120b-v1.2-2.65bpw-h6-exl2 is a text generation model from MatrixC7. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
- The measurement file is attached in the branch measurement.
All-time downloads
222
Public
Repo size
40.5 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors40.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- llama
- Access
- Public
- Created
- Jan 20, 2024
- Updated
- Jan 20, 2024
- SHA
- 90fa2d15
Try a prompt
Model card
From the Hugging Face model README
- The measurement file is attached in the branch
measurement.
Venus 120b - version 1.2
Overview
Version 1.2 of the Venus 120b lineup.
Model Details
- A result of interleaving layers of lizpreciatior/lzlv_70b_fp16_hf with itself.
- The resulting model has 140 layers and approximately 122 billion parameters.
- See mergekit-config.yml for details on the merge method used.
- See the
exl2-*branches for exllama2 quantizations. The 4.85 bpw quant should fit in 80GB VRAM, and the 3.0 bpw quant should (just barely) fit in 48GB VRAM with 4k context. - Inspired by Goliath-120b
Warning: This model will produce NSFW content!
Results
Better at following instructions than both v1.1 and v1.0, and doesn't seem to suffer from censorship issues. Overall I like this version the most out of all the models I've created.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Languages
- en
- Created
- Jan 20, 2024
- Updated
- Jan 20, 2024