DPO-MCQA-FalseMixin

Model Card for Model ID

Finetuned version of MBZUAI/LaMini-Flan-T5-783M for MCQA answer. Produced in the context of EPFL course CS-552 : Modern Natural Language Processing

Model Details

Model Description

<!-- Provide a longer summary of what this model is. -->

• Developed by: MNLPredators
• Model type: Seq2Seq
• Language(s) (NLP): English
• Finetuned from model : MBZUAI/LaMini-Flan-T5-783M

Model Sources [optional]

<!-- Provide the basic links for the model. -->

• Repository: (MNLPredators repo)[https://github.com/CS-552/project-m3-2024-mnlpredators/tree/main]
• Paper [optional]: [More Information Needed]

Pipeline

Training Details

Training Data

<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->

[More Information Needed]

Training Procedure

<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->

Preprocessing [optional]

[More Information Needed]

Training Hyperparameters

• Training regime: [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->

Speeds, Sizes, Times [optional]

<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->

[More Information Needed]