Downloads · 30 days
16
5% of all-time downloads
masakhane/zephyr-7b-gemma-sft-african-ultrachat
zephyr-7b-gemma-sft-african-ultrachat is a text generation model from masakhane. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as gemma.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
16
5% of all-time downloads
All-time downloads
336
Public
Parameters
8.5B
17.1 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors17.1 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of google/gemma-7b on the masakhane/african-ultrachat dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 1.1942 | 1.0 | 2089 | 1.1757 |
| 0.952 | 2.0 | 4178 | 1.0642 |
| 0.7033 | 3.0 | 6267 | 1.0802 |
import torch
from transformers import pipeline
pipe = pipeline("text-generation", model="masakhane/zephyr-7b-gemma-sft-african-ultrachat", torch_dtype=torch.bfloat16, device_map="auto")
# We use the tokenizer's chat template to format each message - see https://huggingface.co/docs/transformers/main/en/chat_templating
messages = [
{
"role": "system",
"content": "You are a friendly chatbot who always responds in the style of a pirate",
},
{"role": "user", "content": "ሰላም እንዴት ነህ?"},
]
prompt = pipe.tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
outputs = pipe(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
print(outputs[0]["generated_text"])
# <|system|>
# You are a friendly chatbot who always responds in the style of a pirate<eos>
# <|user|>
# ሰላም እንዴት ነህ?<eos>
# <|assistant|>
# ሰላም እንዴት ነህ/ነሽ? እኔም በጤና ነኝ። እንደምን ነህ/ነሽ እና የምትፈልገው እንዴት ነው?