xlmr-ner-slavic-pline

This is a Huggingface's transformer library pipeline-frendly model ivlcic/xlmr-ner-slavic

Usage:

ner = pipeline(
    task="token-classification",
    model="ivlcic/xlmr-ner-slavic-pline",
    tokenizer="ivlcic/xlmr-ner-slavic-pline",
    aggregation_strategy="simple",
)
text = " Janez Novak... Metka Kralj,,. in Boris A. Novak živijo v Ljubljani in delajo za Microsoft."
tokens = re.findall(r"\s+|\w+|[^\w\s]", text, flags=re.UNICODE)
result = ner(tokens, is_split_into_words=True, delimiter="")

for r in result[0]:
    print(f'[{text[r['start']:r['end']]}]({r["entity_group"]}@{r["start"]}:{r["end"]})')

Should output something like:

[Janez Novak]([email protected]|1:12)
[Metka Kralj]([email protected]|16:27)
[Boris A. Novak]([email protected]|34:48)
[Ljubljani]([email protected]|58:67)
[Microsoft]([email protected]|81:90)