bert-base-ontonotes5-ner

BERT-base-cased fine-tuned on OntoNotes 5.0

This model is a fine-tuned version of google-bert/bert-base-cased on the English subset of the OntoNotes 5.0 (CoNLL-2012) dataset. It is designed for Named Entity Recognition (NER) and can identify 18 types of entities.

📊 Performance

The model achieves the following results on the OntoNotes 5.0 test set:

🛠 Training Details

• Architecture: BertForTokenClassification
• Tokenizer: BertTokenizerFast (using is_split_into_words=True for alignment)
• Epochs: 5
• Learning Rate: 2e-5
• Batch Size: 16 per device (Total 32 on 2x V100 GPUs)
• Max Sequence Length: 128
• Weight Decay: 0.01
• Mixed Precision (FP16): Enabled

📂 Labels Mapping

The model was trained with the following label mapping (18 OntoNotes entities + BIO tags): CARDINAL, DATE, EVENT, FAC, GPE, LANGUAGE, LAW, LOC, MONEY, NORP, ORDINAL, ORG, PERCENT, PERSON, PRODUCT, QUANTITY, TIME, WORK_OF_ART.

📂 Project Assets

• GitHub Repository: https://github.com/Learnrr/ontonotes5_ner_evaluation.git | Asset | File | Description | | :--- | :--- | :--- | | Model Weights | model.safetensors | Main checkpoint in Safetensors format (safe, fast loading, ~431 MB). | | Configuration | config.json | Model architecture settings and id2label entity mapping. | | Vocabulary | vocab.txt | BERT-cased WordPiece vocabulary for tokenization. | | Tokenizer | tokenizer.json / tokenizer_config.json | Optimized fast tokenizer configuration and serialization. | | Special Tokens | special_tokens_map.json | Definitions for special tokens like [CLS], [SEP], etc. | | Training Args | training_args.bin | Detailed hyperparameter settings used during the training run. |

🚀 Usage

You can use this model directly with a pipeline for token classification:

from transformers import pipeline

model_checkpoint = "learnrr/bert-base-ontonotes5-ner"
token_classifier = pipeline(
    "token-classification", 
    model=model_checkpoint, 
    aggregation_strategy="simple"
)

text = "Apple was founded by Steve Jobs in Cupertino."
results = token_classifier(text)

for entity in results:
    print(f"Entity: {entity['word']} | Label: {entity['entity_group']} | Score: {entity['score']:.4f}")