flan-t5-large-xsum

Model Description

This is a fine-tuned version of google/flan-t5-large using the EdinburghNLP/xsum dataset. The model was trained using 8 A100 GPUs via Accelerate on an HPC cluster.

Hyperparameters

• LEARNING_RATE = 2e-6
• BATCH_SIZE = 8
• OPTIMIZER = AdamW w/ betas=(0.9,0.999), eps=1e-8, weight_decay=0.01
• SCHEDULER = Cosine
• WARMUP_STEPS = 100
• GRAD_ACC_STEPS = 10
• NUM_EPOCHS = 3

Metrics

• Evaluation Loss : 1.603
• Perplexity : 4.9679
• BERTScore : {'precision': 0.9127, 'recall': 0.9000, 'f1': 0.9062}
• ROUGE Scores : {'rouge1': 0.3935, 'rouge2': 0.1604, 'rougeL': 0.3139, 'rougeLsum': 0.3139}
• BLEU Score : 0.1002
• Average Generation Length: 26

Example inference

Prompt:<br/> Seven photographs taken in the Norfolk countryside by photographer Josh Olins will appear in the June edition. In her first sitting for a magazine, the duchess is seen looking relaxed and wearing casual clothes. The shoot was in collaboration with the National Portrait Gallery, where two images are being displayed in the Vogue 100: A Century of Style exhibition. The duchess, who has a keen interest in photography, has been patron of the National Portrait Gallery since 2012. Nicholas Cullinan, director of the National Portrait Gallery, said: "Josh has captured the duchess exactly as she is - full of life, with a great sense of humour, thoughtful and intelligent, and in fact, very beautiful." He said the images also encapsulated what Vogue had done over the past 100 years - "to pair the best photographers with the great personalities of the day, in order to reflect broader shifts in culture and society". Alexandra Shulman, editor-in-chief of British Vogue, said: "To be able to publish a photographic shoot with the Duchess of Cambridge has been one of my greatest ambitions for the magazine." The collaboration for the June edition had resulted in "a true celebration of our centenary as well as a fitting tribute to a young woman whose interest in both photography and the countryside is well known", she said. Other royal portraits to have featured in the fashion magazine include Diana, Princess of Wales - who graced the cover four times - and Princess Anne. The duchess is to visit the exhibition at the National Portrait Gallery on Wednesday, Kensington Palace said.

Generated output:<br/> The Duchess of Cambridge is to grace the cover of British Vogue for the first time in 100 years.