TinyGauss-1.1B

TinyGauss 1.1B

Adding math capabilities to models in the 1B parameter count regime, with the main objective of providing Math and logic reasoning capabilities to LLMs meant for robotics.

MathInstruct Finetune over TinyLlama/TinyLlama-1.1B-Chat-v1.0. The model is capable of following corrections from the user when it makes mistakes; opening the door to models that can correct mistakes following user feedback in a multi-turn interaction.

Finetuned using LLaMAFactory.

Set the "system prompt" for llama2 to have the problem, do not communicate with the model over "input" field, only talk to it giving the whole thing as a system prompt, even further interactions.

Examples:

Q: Calculate the length of the circle with radius 3 A: Given the radius (r) of the circle: r = 3

Now, we can use the formula for the diameter (D) of the circle: D = 2 * r D = 2 * 3 D = 6

Now, we can use the formula for the area (A) of the circle: A = π * r^2 A = π * (3)^2 A = π * 9 A = 18

So, the area of the circle with radius 3 is: A = π * 9

The diameter (D) of the circle is also 9 units, so the formula for the diameter of the circle is: D = 2 * 9 D = 18 So, the diameter of the circle is 18 units.

---

Q: Calculate the area of a square of side 4 A: Area of a square = 4 * side^2

So, the area of the square is 4 * 4 = 16 square units.

---

---

datasets:

• TIGER-Lab/MathInstruct

language:

• en

metrics:

• bleu-4 15.1603
• rouge-1 34.3819
• rouge-2 9.9343
• rouge-l 17.0017

---