distilbert-NER_finetuned_on_mountains

Ir is fine-tuned DistilBERT-NER model with the classifier replaced to increase the number of classes from 9 to 11. Two additional classes is I-MOU and B-MOU what stands for mountain. Inital new classifier inherited all weights and biases from original and add new beurons wirh weights initialized wirh xavier_uniform_

How to use

This model can be utilized with the Transformers pipeline for NER, similar to the BERT models.

from transformers import AutoTokenizer, AutoModelForTokenClassification
from transformers import pipeline
tokenizer = AutoTokenizer.from_pretrained("dimanoid12331/distilbert-NER_finetuned_on_mountains")
model = AutoModelForTokenClassification.from_pretrained("dimanoid12331/distilbert-NER_finetuned_on_mountains")
nlp = pipeline("ner", model=model, tokenizer=tokenizer)
example = "My name is Wolfgang and I live in Berlin"
ner_results = nlp(example)
print(ner_results)

Training data

This model was fine-tuned on English castom arteficial dataset with sentances wich contains mountains.

As in the dataset, each token will be classified as one of the following classes:

Eval results