GemMath-2b-gguf

GemMath

This model is a domain-specific fine-tuned LLM model which is specialized in mathematical inferences and deductions, based on Gemma2 LLM model.

Model Description

• Developed by: Nathan Kim (NK590)
• Model type: LLM model
• Language(s) (NLP): English
• License: MIT
• Finetuned from model: gemma2-2b

Uses

You can import .gguf file with ollama to run this model. For example, make Modelfile file below in the same directory with .gguf file,

FROM unsloth.Q8_0.gguf

TEMPLATE """{{- if .System }}
<s>{{ .System }}</s>
{{- end }}
<s>Human:
{{ .Prompt }}</s>
<s>Assistant:
"""

SYSTEM """A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions."""

PARAMETER temperature 0
PARAMETER num_predict 3000
PARAMETER num_ctx 4096
PARAMETER stop <s>
PARAMETER stop </s>

then run the following command to read on ollama:

ollama create {model_name} -f Modelfile

finally, you can run this model on ollama. Enjoy!

ollama run {model_name}

Training Data

This model was fine-tuned using orca-math-word-problems-200k dataset.