Soaring-8b

Model Card for Llama3-8b-FlyingManual-Tutor

This model is a fine-tuned version of the Llama3-8b model, specifically trained on the FlyingManual dataset to serve as an AI tutor for aviation-related subjects. It is designed to provide guidance and nudge users when they answer questions incorrectly.

Model Details

Model Description

• Developed by: Canarie Teams
• Model type: Large Language Model (LLM) for AI Tutoring
• Language(s) (NLP): English (primary), potentially others depending on the FlyingManual dataset
• Finetuned from model: Llama3-8b by Meta AI

How to Get Started with the Model

from transformers import AutoTokenizer, AutoModelForCausalLM

model_name = "path/to/your/Llama3-8b-FlyingManual-Tutor"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)

# Example usage for tutoring
def tutor_interaction(question, user_answer):
    prompt = f"Question: {question}\nUser Answer: {user_answer}\nTutor Response:"
    inputs = tokenizer(prompt, return_tensors="pt")
    outputs = model.generate(**inputs, max_length=200)
    response = tokenizer.decode(outputs[0], skip_special_tokens=True)
    return response.split("Tutor Response:")[-1].strip()

# Example
question = "What are the primary flight controls of an aircraft?"
user_answer = "Steering wheel and gas pedal"
tutor_feedback = tutor_interaction(question, user_answer)
print(tutor_feedback)

Training Details

Training Data

The model was fine-tuned on the FlyingManual dataset, augmented with:

• Sample Q&A pairs related to aviation topics
• Examples of constructive feedback and explanations
• Scenarios demonstrating correct and incorrect responses to aviation-related questions

Training Procedure

Preprocessing

• Conversion of training data into a dialogue format suitable for tutoring interactions
• Augmentation of data with tutoring-specific tokens or markers

Training Hyperparameters

---

Evaluation

Testing Data, Factors & Metrics

Testing Data

A held-out portion of the FlyingManual dataset, supplemented with:

• A set of typical student questions and answers
• Scenarios designed to test the model's ability to provide constructive feedback

Metrics

• Human evaluation of tutoring quality (clarity, accuracy, helpfulness)
• Task-specific metrics (e.g., ability to correctly identify and address user mistakes)

Results

[Provide the evaluation results here]

Environmental Impact

• Hardware Type: 8 x NVIDIA A100 40GB GPUs

Model Card Authors

Canarie Teams

Model Card Contact

[Your contact information or a link to where people can reach out with questions]