Downloads · 30 days
39
1% of all-time downloads
akdeniz27/bert-base-hungarian-cased-ner
bert-base-hungarian-cased-ner is a token classification model from akdeniz27. Use it when you need labels on individual words, such as names. It is set up for transformers. The card lists the license as mit.
This model is the fine-tuned model of "SZTAKI-HLT/hubert-base-cc" using the famous WikiANN dataset presented in the "Cross-lingual Name Tagging and Linking for 282 Languages" paper.
Downloads · 30 days
39
1% of all-time downloads
All-time downloads
6.5K
Public
Parameters
110M
880 MB on disk
Likes
3
Public
Click a slice to open those files.
.bin440 MB · 50%
How the weights are stored.
F32110M · 100%
From the Hugging Face model README
This model is the fine-tuned model of "SZTAKI-HLT/hubert-base-cc" using the famous WikiANN dataset presented in the "Cross-lingual Name Tagging and Linking for 282 Languages" paper.
task = "ner"
model_checkpoint = "SZTAKI-HLT/hubert-base-cc"
batch_size = 8
label_list = ['O', 'B-PER', 'I-PER', 'B-ORG', 'I-ORG', 'B-LOC', 'I-LOC']
max_length = 512
learning_rate = 2e-5
num_train_epochs = 3
weight_decay = 0.01
model = AutoModelForTokenClassification.from_pretrained("akdeniz27/bert-base-hungarian-cased-ner")
tokenizer = AutoTokenizer.from_pretrained("akdeniz27/bert-base-hungarian-cased-ner")
ner = pipeline('ner', model=model, tokenizer=tokenizer, aggregation_strategy="first")
ner("<your text here>")
Pls refer "https://huggingface.co/transformers/_modules/transformers/pipelines/token_classification.html" for entity grouping with aggregation_strategy parameter.