Downloads · 30 days
9
6% of all-time downloads
aya-expanse-8b-gptqmodel-4bit
iproskurina/aya-expanse-8b-gptqmodel-4bit
aya-expanse-8b-gptqmodel-4bit is a text generation model from iproskurina. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
All-time downloads
140
Public
Parameters
8B
5.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.7 GB · 100%
Parameter types
How the weights are stored.
I327B · 87%
Try a prompt
Datasets
Model card
From the Hugging Face model README
aya-expanse-8b - GPTQ (4-bit)
Source model: CohereLabs/aya-expanse-8b
This model was quantized to 4-bit using GPTQModel.
Quantization parameters:
- bits: 4
- group_size: 128
- damp_percent: 0.05
- desc_act: False
Usage
# pip install transformers gptqmodel --no-build-isolation
from gptqmodel import GPTQModel
model_id = "iproskurina/aya-expanse-8b-gptqmodel-4bit"
model = GPTQModel.load(model_id)
result = model.generate("Uncovering deep insights")[0]
print(model.tokenizer.decode(result))
- Task
- Text Generation
- Library
- transformers
- Type
- cohere
- License
- cc-by-nc-4.0
- Languages
- en
- Created
- Oct 30, 2025
- Updated
- Oct 31, 2025