Downloads · 30 days
259
5% of all-time downloads
RichardErkhov/yam-peleg_-_Hebrew-Gemma-11B-Instruct-gguf
yam-peleg_-_Hebrew-Gemma-11B-Instruct-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
259
5% of all-time downloads
All-time downloads
5.3K
Public
Repo size
122 GB
Likes
0
Public
Click a slice to open those files.
.gguf141 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Hebrew-Gemma-11B-Instruct - GGUF
license: other license_name: gemma-terms-of-use license_link: https://ai.google.dev/gemma/terms language:
The Hebrew-Gemma-11B-Instruct Large Language Model (LLM) is a instruct fine-tuned version of the Hebrew-Gemma-11B generative text model using a variety of conversation datasets.
It is continued pretrain of gemma-7b, extended to a larger scale and trained on 3B additional tokens of both English and Hebrew text data.
This format must be strictly respected, otherwise the model will generate sub-optimal outputs.
<bos><start_of_turn>user
Write a hello world program<end_of_turn>
<start_of_turn>model
Here is a simple hellow world program<end_of_turn><eos>
<bos>.<start_of_turn> delimiter and then the role of the entity (user or model).<end_of_turn> token.<eos> token.You can follow this format to build the prompt manually, if you need to do it without the tokenizer's chat template.
A simple example using the tokenizer's chat template:
from transformers import AutoTokenizer, AutoModelForCausalLM
model_id = "Hebrew-Gemma-11B-Instruct"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, device_map="cuda")
chat = [
{ "role": "user", "content": "כתוב קוד פשוט בפייתון שמדפיס למסך את התאריך של היום" },
]
prompt = tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=True)
As an extention of Gemma-7B, this model is subject to the original license and terms of use by Google.
Hebrew-Gemma-11B is a pretrained base model and therefore does not have any moderation mechanisms.