Downloads · 30 days
11
15% of all-time downloads
ashrafulparan/Aya-23-8b-4bit-bnb
Aya-23-8b-4bit-bnb is a text generation model from ashrafulparan. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
This is the 4bit Quantized version of the Aya 23 8B. It uses 4x less memory.
Downloads · 30 days
11
15% of all-time downloads
All-time downloads
72
Public
Parameters
8.1B
6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6 GB · 100%
How the weights are stored.
U87B · 86%
From the Hugging Face model README
This is the 4bit Quantized version of the Aya 23 8B. It uses 4x less memory.