ModernBERT-domain-classifier

esekeroglu/ModernBERT-domain-classifier

ModernBERT-domain-classifier is a text classification model from esekeroglu. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

52% of all-time downloads

All-time downloads

Public

Parameters

150M

18.6 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors599 MB · 99%

At a glance

Task: Text Classification
Library: transformers
License: apache-2.0
Model type: modernbert
Access: Public
Created: Jan 29, 2025
Updated: Jan 30, 2025
SHA: 462f1838

Try a prompt

Base models

answerdotai/ModernBERT-base

Model card

From the Hugging Face model README

ModernBERT-domain-classifier

This model is a fine-tuned version of answerdotai/ModernBERT-base on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.3117
F1: 0.9342

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 7e-05
train_batch_size: 64
eval_batch_size: 32
seed: 42
optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 7

Training results

Training Loss	Epoch	Step	Validation Loss	F1
No log	1.0	15	0.6936	0.8593
No log	2.0	30	0.4958	0.8719
No log	3.0	45	0.3710	0.9093
No log	4.0	60	0.3575	0.8912
No log	5.0	75	0.3046	0.9366
No log	6.0	90	0.3042	0.9398
0.4101	7.0	105	0.3117	0.9342

Framework versions

Transformers 4.48.0.dev0
Pytorch 2.5.1+cu124
Datasets 3.1.0
Tokenizers 0.21.0

Task: Text Classification
Library: transformers
Type: modernbert
License: apache-2.0
Created: Jan 29, 2025
Updated: Jan 30, 2025