Downloads · 30 days
6
8% of all-time downloads
manu02/kani-tts-2-pt-bnb-4bit-nf4-dq
kani-tts-2-pt-bnb-4bit-nf4-dq is a text generation model from manu02. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a 4-bit quantized version of the original nineninesix/kani-tts-2-pt model, optimized for reduced memory usage while maintaining performance.
Downloads · 30 days
6
8% of all-time downloads
All-time downloads
73
Public
Parameters
379M
313 MB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors313 MB · 98%
How the weights are stored.
U8296M · 78%
From the Hugging Face model README
This model is a 4-bit quantized version of the original nineninesix/kani-tts-2-pt model, optimized for reduced memory usage while maintaining performance.
from transformers import AutoModel, AutoTokenizer
model_name = "kani-tts-2-pt-bnb-4bit-nf4"
model = AutoModel.from_pretrained(
"manu02/kani-tts-2-pt-bnb-4bit-nf4",
)
tokenizer = AutoTokenizer.from_pretrained("manu02/kani-tts-2-pt-bnb-4bit-nf4", use_fast=True)