Downloads · 30 days
18
2% of all-time downloads
gustavecortal/gpt-j-fr-covid-news
gpt-j-fr-covid-news is a text generation model from gustavecortal. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is a version of Cedille's GPT-J (fr-boris) with 6 billion parameters fine-tuned on COVID-19 French News dataset to generate French headlines related to COVID-19.
Downloads · 30 days
18
2% of all-time downloads
All-time downloads
1K
Public
Repo size
12.4 GB
Likes
1
Public
Click a slice to open those files.
.bin6.2 GB · 100%
From the Hugging Face model README
This is a version of Cedille's GPT-J (fr-boris) with 6 billion parameters fine-tuned on COVID-19 French News dataset to generate French headlines related to COVID-19.
You can generate the model in colab or equivalent desktop gpu (e.g. single 1080Ti) as the model has 8-bit weights. Inspired by GPT-J 8bit.
This model can be easily loaded using the GPTJForCausalLM functionality:
from transformers import GPTJForCausalLM
model = GPTJForCausalLM.from_pretrained("gustavecortal/gpt-j-fr-covid-news")
Remember, you have to Monkey-Patch the model before loading it (see Colab above).
How not to be disoriented in a pandemic era when faced with an immense flow of information? This page features one thousand AI-generated French headlines related to COVID-19.
Boris is a 6B parameter autoregressive language model based on the GPT-J architecture and trained using the mesh-transformer-jax codebase.
Boris was trained on around 78B tokens of French text from the C4 dataset.