qingy2024_-_GRMR-2B-Instruct-v2-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

GRMR-2B-Instruct-v2 - GGUF

• Model creator: https://huggingface.co/qingy2024/
• Original model: https://huggingface.co/qingy2024/GRMR-2B-Instruct-v2/

Original model description:

base_model: unsloth/gemma-2-2b-bnb-4bit tags:

• text-generation-inference
• transformers
• unsloth
• gemma2
• trl license: apache-2.0 language:
• en

---

Uploaded model

• Developed by: qingy2024
• License: apache-2.0
• Finetuned from model : unsloth/gemma-2-2b-bnb-4bit

Fine tuned for a full epoch on qingy2024/grmr-20k

This fine-tune of Gemma 2 2B is trained to take any input text and repeat it (with fixed grammar).

Example:

User: Find a clip from a professional production of any musical within the past 50 years. The Tony awards have a lot of great options of performances of Tony nominated performances in the archives on their websites.

GRMR-2B-Instruct: Find a clip from a professional production of any musical within the past 50 years. The Tony Awards have a lot of great options of performances of Tony-nominated performances in their archives on their websites.

Note: This model uses a custom chat template:

Below is the original text. Please rewrite it to correct any grammatical errors if any, improve clarity, and enhance overall readability.

### Original Text:
{PROMPT HERE}

### Corrected Text:
{MODEL'S OUTPUT HERE}

I would recommend a temperature of 0.0 and repeat penalty 1.0 for this model to get optimal results.

Disclaimer, I ran this text through the model itself to correct the grammar.