Downloads · 30 days
7
13% of all-time downloads
FuturisticVibes/aya-23-35B-8.0bpw-h8-exl2
aya-23-35B-8.0bpw-h8-exl2 is a text generation model from FuturisticVibes. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
I have no idea what I’m doing… if this causes the apocalypse someone please let me know.
Downloads · 30 days
7
13% of all-time downloads
All-time downloads
52
Public
Repo size
39.2 GB
Likes
0
Public
Click a slice to open those files.
.safetensors39.2 GB · 100%
From the Hugging Face model README
I have no idea what I’m doing… if this causes the apocalypse someone please let me know.
aya-23-35B 8.0bpw h8 EXL2
Includes measurement.json file for further quantization
Original Model: https://huggingface.co/CohereForAI/aya-23-35B
Aya 23 is an open weights research release of an instruction fine-tuned model with highly advanced multilingual capabilities. Aya 23 focuses on pairing a highly performant pre-trained Command family of models with the recently released Aya Collection. The result is a powerful multilingual large language model serving 23 languages.
This model card corresponds to the 35-billion version of the Aya 23 model. We also released an 8-billion version which you can find here.
We cover 23 languages: Arabic, Chinese (simplified & traditional), Czech, Dutch, English, French, German, Greek, Hebrew, Hindi, Indonesian, Italian, Japanese, Korean, Persian, Polish, Portuguese, Romanian, Russian, Spanish, Turkish, Ukrainian, and Vietnamese
Developed by: Cohere For AI and Cohere
Try Aya 23
You can try out Aya 23 (35B) before downloading the weights in our hosted Hugging Face Space here.
Please install transformers from the source repository that includes the necessary changes for this model
# pip install 'git+https://github.com/huggingface/transformers.git'
from transformers import AutoTokenizer, AutoModelForCausalLM
model_id = "CohereForAI/aya-23-35B"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)
# Format message with the command-r-plus chat template
messages = [{"role": "user", "content": "Anneme onu ne kadar sevdiğimi anlatan bir mektup yaz"}]
input_ids = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt")
## <BOS_TOKEN><|START_OF_TURN_TOKEN|><|USER_TOKEN|>Anneme onu ne kadar sevdiğimi anlatan bir mektup yaz<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>
gen_tokens = model.generate(
input_ids,
max_new_tokens=100,
do_sample=True,
temperature=0.3,
)
gen_text = tokenizer.decode(gen_tokens[0])
print(gen_text)
This notebook showcases a detailed use of Aya 23 (8B) including inference and fine-tuning with QLoRA.
Input: Models input text only.
Output: Models generate text only.
Model Architecture: Aya-23-35B is an auto-regressive language model that uses an optimized transformer architecture. After pretraining, this model is fine-tuned (IFT) to follow human instructions.
Languages covered: The model is particularly optimized for multilinguality and supports the following languages: Arabic, Chinese (simplified & traditional), Czech, Dutch, English, French, German, Greek, Hebrew, Hindi, Indonesian, Italian, Japanese, Korean, Persian, Polish, Portuguese, Romanian, Russian, Spanish, Turkish, Ukrainian, and Vietnamese
Context length: 8192
Please refer to the Aya 23 technical report for further details about the base model, data, instruction tuning, and evaluation.
For errors or additional questions about details in this model card, contact [email protected].
We hope that the release of this model will make community-based research efforts more accessible, by releasing the weights of a highly performant multilingual model to researchers all over the world. This model is governed by a CC-BY-NC License with an acceptable use addendum, and also requires adhering to C4AI's Acceptable Use Policy.
You can try Aya 23 in the Cohere playground here. You can also use it in our dedicated Hugging Face Space here.
@misc{aya23technicalreport,
title={Aya 23: Open Weight Releases to Further Multilingual Progress},
author={Viraat Aryabumi, John Dang, Dwarak Talupuru, Saurabh Dash, David Cairuz, Hangyu Lin, Bharat Venkitesh, Madeline Smith, Kelly Marchisio, Sebastian Ruder, Acyr Locatelli, Julia Kreutzer, Nick Frosst, Phil Blunsom, Marzieh Fadaee, Ahmet Üstün, and Sara Hooker},
url={https://cohere.com/research/papers/aya-command-23-8b-and-35b-technical-report-2024-05-23},
year={2024}
}