Downloads · 30 days
331
1% of all-time downloads
aya-101-GGUF
kcoopermiller/aya-101-GGUF
aya-101-GGUF is a machine learning model from kcoopermiller. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This repo contains GGUF format model files for Cohere's Aya-101 model
All-time downloads
33.4K
Public
Repo size
113 GB
Likes
16
Public
Repo makeup
Click a slice to open those files.
.gguf113 GB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- t5
- Access
- Public
- Created
- Feb 27, 2024
- Updated
- Mar 1, 2024
- SHA
- 90c93fbd
Model card
From the Hugging Face model README
Aya-101-GGUF
This repo contains GGUF format model files for Cohere's Aya-101 model
Quantized using Huggingface's candle framework
How to use with Candle's quantized T5 example
Visit the candle T5 example for more detailed instruction
- Clone candle repo:
git clone https://github.com/huggingface/candle.git
cd candle/candle-examples
- Run the following command:
cargo run --example quantized-t5 --release -- \
--model-id "kcoopermiller/aya-101-GGUF" \
--weight-file "aya-101.Q2_K.gguf" \
--config-file "config.json" \
--prompt "भारत में इतनी सारी भाषाएँ क्यों हैं?" \
--temperature 0
Available weight files:
- aya-101.Q2_K.gguf
- aya-101.Q3_K.gguf
- aya-101.Q4_0.gguf
- aya-101.Q4_1.gguf
- aya-101.Q4_K.gguf
- aya-101.Q5_0.gguf
- aya-101.Q5_1.gguf
- aya-101.Q5_K.gguf
- aya-101.Q6_K.gguf
- aya-101.Q8_0.gguf
- aya-101.Q8_1.gguf (not supported on candle yet)
- aya-101.Q8_K.gguf (not supported on candle yet)
- Library
- transformers
- Type
- t5
- License
- apache-2.0
- Languages
- afr, amh, ara, aze, bel, ben
- Created
- Feb 27, 2024
- Updated
- Mar 1, 2024