Downloads · 30 days
201
8% of all-time downloads
gpt2-small-catalan-v2
ClassCat/gpt2-small-catalan-v2
gpt2-small-catalan-v2 is a text generation model from ClassCat. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-sa-4.0.
All-time downloads
2.4K
Public
Repo size
2.7 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin166 MB · 98%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-sa-4.0
- Model type
- gpt2
- Access
- Public
- Created
- Jul 14, 2022
- Updated
- Jul 16, 2022
- SHA
- 6561d0e7
Try a prompt
Model card
From the Hugging Face model README
GPT2 Catalan small model Version 2 (Uncased)
Prerequisites
transformers==4.19.2
Model architecture
This model uses GPT2 base model settings, but the size of embedding dimensions are half the size of them.
Tokenizer
Using BPE tokenizer with vocabulary size 50,000.
Training Data
- wiki40b/ca (Catalan Wikipedia)
- Subset of oscar
- Subset of CC-100/ca : Monolingual Datasets from Web Crawl Data
Usage
from transformers import pipeline
unmasker = pipeline('fill-mask', model='ClassCat/gpt2-small-catalan-v2')
unmasker("Ell està una mica")
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- cc-by-sa-4.0
- Languages
- ca
- Created
- Jul 14, 2022
- Updated
- Jul 16, 2022