Downloads · 30 days
15
16% of all-time downloads
aurelian-alpha0.1-70b-rope8-32K-6bpw_h8_exl2
grimulkan/aurelian-alpha0.1-70b-rope8-32K-6bpw_h8_exl2
aurelian-alpha0.1-70b-rope8-32K-6bpw_h8_exl2 is a text generation model from grimulkan. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as unknown.
This is a 6-bit EXL2 quantization of Aurelian v0.1alpha 70B 32K for testing & feedback. See that page for more details.
All-time downloads
91
Public
Repo size
52.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors52.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- unknown
- Model type
- llama
- Access
- Public
- Created
- Dec 9, 2023
- Updated
- Jan 11, 2024
- SHA
- 2657edd8
Try a prompt
Model card
From the Hugging Face model README
This is a 6-bit EXL2 quantization of Aurelian v0.1alpha 70B 32K for testing & feedback. See that page for more details.
This quantization fits in 48GB+24GB (36/24 split) or 3x24GB (16/17/20 split) using Exllamav2 @ 32k context.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- unknown
- Created
- Dec 9, 2023
- Updated
- Jan 11, 2024