Downloads · 30 days
35
6% of all-time downloads
bert-br-portuguese
jcfneto/bert-br-portuguese
bert-br-portuguese is a machine learning model from jcfneto. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
probably proofread and complete it, then remove this comment. --
All-time downloads
613
Public
Repo size
286 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.h5286 MB · 100%
At a glance
- Library
- transformers
- License
- mit
- Model type
- bert
- Access
- Public
- Created
- Apr 20, 2023
- Updated
- Nov 13, 2023
- SHA
- 0dfd44b9
Model card
From the Hugging Face model README
<!-- This model card has been generated automatically according to the information Keras had access to. You should
probably proofread and complete it, then remove this comment. -->
BERT-BR
<img src="https://cdn-uploads.huggingface.co/production/uploads/6385e26cc12615765caa6afe/3lSkNEfW57BNudZIFyTH2.png" width=400 height=400> Image generated by ChatGPT with DALL-E from OpenAI.Model description
BERT-BR is a BERT model pre-trained from scratch on a dataset of literary book reviews in Brazilian Portuguese. The model is specifically designed for understanding the context and sentiment of book reviews in Portuguese. BERT-BR features 6 layers, 4 attention heads, and an embedding dimension of 768.
Training data
The BERT-BR model was pre-trained on a dataset of literary book reviews in Brazilian Portuguese. The dataset comprises a diverse range of book genres and review sentiments, making the model suitable for various book-related NLP tasks in Portuguese.
Usage ideas
- Sentiment analysis on book reviews in Portuguese
- Book recommendation systems in Portuguese
- Text classification for book genres in Portuguese
- Named entity recognition in book-related contexts in Portuguese
- Aspect extraction in book-related contexts in Portuguese
- Text generation for book summaries in Portuguese
Limitations and bias
As the BERT-BR model was pre-trained on literary book reviews in Brazilian Portuguese, it may not perform as well on other types of text or reviews in different languages. Additionally, the model may inherit certain biases from the training data, which could affect its predictions or embeddings. The tokenizer is based on the BERTimbau tokenizer, which was specifically designed for Brazilian Portuguese text, so it might not work well with other languages or Portuguese variants.
Framework versions
- Transformers 4.21.3
- TensorFlow 2.9.1
- Datasets 2.7.0
- Tokenizers 0.12.1
- Library
- transformers
- Type
- bert
- License
- mit
- Languages
- pt
- Created
- Apr 20, 2023
- Updated
- Nov 13, 2023