Downloads · 30 days
0
BERT_CNN_civil_comments
jfia0107/BERT_CNN_civil_comments
BERT_CNN_civil_comments is a machine learning model from jfia0107. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Trained using https://github.com/jfia0107/PyTorch-Lightning-NLP-lab and these parameters:<br / freezebackbone: True<br / unfreezetopn: 2<br / scheduler: linearwarmup<br / warmupratio: 0.1<br / pretrainedmodel: distilr…
Access
Public
Updated Apr 17, 2026
Repo size
448 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.ckpt448 MB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Apr 17, 2026
- Updated
- Apr 17, 2026
- SHA
- 2e164fb1
Model card
From the Hugging Face model README
Trained using https://github.com/jfia0107/PyTorch-Lightning-NLP-lab and these parameters:<br /> freeze_backbone: True<br /> unfreeze_top_n: 2<br /> scheduler: linear_warmup<br /> warmup_ratio: 0.1<br /> pretrained_model: distilroberta-base<br /> attn_implementation: flash_attention_2<br /> head_num_filters: 64<br /> head_input_size: 300<br /> head_filter_sizes: [1, 2, 3, 4]<br /> dropout: 0.3<br /> batch_size: 2048<br /> max_epochs: 5<br /> optimizer: torch.optim.AdamW<br /> bbone_lr: 0.0001<br /> head_lr: 0.0003<br /> weight_decay: 0.01<br /> minority_ratio: 0.05<br />
- License
- mit
- Created
- Apr 17, 2026
- Updated
- Apr 17, 2026