Downloads · 30 days
0
BERT_civil_comments
jfia0107/BERT_civil_comments
BERT_civil_comments is a machine learning model from jfia0107. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Trained using https://github.com/jfia0107/PyTorch-Lightning-NLP-lab and these parameters: <br /
Access
Public
Updated Apr 17, 2026
Repo size
442 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.ckpt442 MB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Apr 17, 2026
- Updated
- Apr 17, 2026
- SHA
- 7714a14a
Model card
From the Hugging Face model README
Trained using https://github.com/jfia0107/PyTorch-Lightning-NLP-lab and these parameters: <br />
freeze_backbone: True <br /> unfreeze_top_n: 2 <br /> scheduler: linear_warmup <br /> warmup_ratio: 0.1<br /> pretrained_model: distilroberta-base<br /> attn_implementation: flash_attention_2<br /> head_dropout: 0.1<br /> batch_size: 2048<br /> max_epochs: 5<br /> optimizer: torch.optim.AdamW<br /> bbone_lr: 0.0001<br /> head_lr: 0.0003<br /> weight_decay: 0.01<br /> minority_ratio: 0.05<br />
- License
- mit
- Created
- Apr 17, 2026
- Updated
- Apr 17, 2026