finetuned-gpt2

Model Card for Model ID

This model card documents a GPT-2 model fine-tuned on a dataset of multiple-choice medical exam questions. The model has been trained to generate answers based on a given question and corresponding options.

Model Details

Model Description

• Developed by: Jaimin Shah
• Model type: GPT-2 Language Model, fine-tuned for question-answering tasks
• Language(s) (NLP): English
• License: [More Information Needed]
• Finetuned from model [optional]: GPT-2 (openai-community/gpt2)

Uses

Direct Use

This model can be used to automatically generate answers for multiple-choice medical exam questions. It is suited for educational purposes, quiz generation, and training applications.

Training Details

Training Data

182,822 training samples

Preprocessing

The input was tokenized with Hugging Face's GPT-2 tokenizer. Data was formatted as a question followed by the answer options.

Training Hyperparameters

Number of Training Epochs: 20 Batch Size (Training): 64 Learning Rate: 1e-5 Mixed Precision (FP16): True

Evaluation

Batch Size (Evaluation): 64

Testing Data, Factors & Metrics

Testing Data: The model was evaluated on a held-out validation set of medical exam questions. Factors: The model's ability to select the correct answer from the given options was the key evaluation factor. Metrics: Cross-entropy loss was used to monitor performance during training, with validation loss used to evaluate generalization.

Results

Training Loss: Decreased from 1.8577 to 1.6961 over 20 epochs. Validation Loss: Decreased from 1.8692 to 1.7394, demonstrating good generalization performance.