Downloads · 30 days
16
3% of all-time downloads
opt-125m-pt-finetuned
thiagolaitz/opt-125m-pt-finetuned
opt-125m-pt-finetuned is a text generation model from thiagolaitz. Use it when you need the model to write or continue text. It is set up for transformers.
This model is a Portuguese fine-tuned version of the facebook/opt-125m. It has undergone additional causal language modeling pre-training with a context size of 512, using an extra 300 million tokens in Portuguese (sa…
All-time downloads
607
Public
Repo size
1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin501 MB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- opt
- Access
- Public
- Created
- Mar 27, 2023
- Updated
- Mar 28, 2023
- SHA
- 3faf271f
Datasets
Model card
From the Hugging Face model README
This model is a Portuguese fine-tuned version of the facebook/opt-125m. It has undergone additional causal language modeling pre-training with a context size of 512, using an extra 300 million tokens in Portuguese (sampled from mc4). The Wandb report is publicly available at here. The code for training using Colab pro (A100 - 40GB) can be found here. The total cost for training this model was R$17.40 or $3.37 USD (as of March 2023).
Deterministic use:
from transformers import pipeline
generator = pipeline('text-generation', model="thiagolaitz/opt-125m-pt-finetuned", max_length=30)
generator("Eles brincaram o dia inteiro sob o sol quente, mas")
# Output: Eles brincaram o dia inteiro sob o sol quente, mas não se deixaram levar pelo sol.
Top-k sampling:
from transformers import pipeline
generator = pipeline('text-generation', model="thiagolaitz/opt-125m-pt-finetuned", do_sample=True, max_length=30)
generator("Eles brincaram o dia inteiro sob o sol quente, mas")
- Task
- Text Generation
- Library
- transformers
- Type
- opt
- Languages
- pt
- Created
- Mar 27, 2023
- Updated
- Mar 28, 2023