Downloads · 30 days
41
4% of all-time downloads
LuxGPT2
laurabernardy/LuxGPT2
LuxGPT2 is a text generation model from laurabernardy. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
The model with the best performance of this experiment is: laurabernardy/LuxGPT2-basedGER.
All-time downloads
1K
Public
Parameters
138M
1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin516 MB · 50%
Parameter types
How the weights are stored.
F32126M · 91%
Model card
From the Hugging Face model README
LuxGPT-2
The model with the best performance of this experiment is: laurabernardy/LuxGPT2-basedGER.
GPT-2 model for Text Generation in luxembourgish language, trained on 667 MB of text data, consisting of RTL.lu news articles, comments, parlament speeches, the luxembourgish Wikipedia, Newscrawl, Webcrawl and subtitles. The training took place on a 32 GB Nvidia Tesla V100
- with an initial learning rate of 5e-5
- with Batch size 4
- for 109 hours
- for 30 epochs
- using the transformers library <br/>
more detailed training information can be found in the "trainer_state.json".
Usage
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("laurabernardy/LuxGPT2")
model = AutoModelForCausalLM.from_pretrained("laurabernardy/LuxGPT2")
Limitations and Biases
See the GPT2 model card for considerations on limitations and bias. See the GPT2 documentation for details on GPT2.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- mit
- Languages
- lb
- Created
- Aug 22, 2022
- Updated
- Mar 19, 2025