qlora-codellama-7b-unnatural_instructions

for testing purposes only. qlora trained using peft on codellama/CodeLlama-7b-hf as base model. trained on mrm8488/unnatural-instructions, config 'core' dataset.

training data transformed to the following structure for testing purposes:

Example 1:
Input: <s>[INST] <<SYS>>
You are a helpful, respectful and honest assistant. Always answer as helpfully as possible.

If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
<</SYS>>

In this task, you are given a set of courses and a list of prerequisites. The task is to find the order in which the courses have to be taken so that no course appears before its prerequisite has been completed. Output the correct order as a single string where each element is separated by '-'.
Courses: C1,C2,C3<sep>Prerequisites: [C2, C3], [], []. [/INST]
Output: C2-C3-C1


Example 2:
Input: <s>[INST] <<SYS>>
You are a helpful, respectful and honest assistant. Always answer as helpfully as possible.

If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
<</SYS>>

Find the number of unique words present in this string. A word is defined as a sequence of non-white spaces characters.
"One two         three\n  four\tfive  ". [/INST]
Output: There are 11 unique words in the input text.


Example 3:
Input: <s>[INST] <<SYS>>
You are a helpful, respectful and honest assistant. Always answer as helpfully as possible.

If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
<</SYS>>

You are given a paragraph from an article. Your task is to replace all the third person possessive pronouns in the paragraph with first person pronouns.
His team's plans for the day were quickly ruined when their bus got a flat tire on the way to their first event of the day.
The tournament organizers were not very happy with his team when they showed up late to their match. [/INST]
Output: Our team's plans for the day were quickly ruined when our bus got a flat tire on the way to our first event of the day.
The tournament organizers were not very happy with us when we showed up late to our match.