Downloads · 30 days
636
10% of all-time downloads
metinovadilet/KyrgyzBert
KyrgyzBert is a fill-mask model from metinovadilet. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
KyrgyzBert is a small-scale BERT-based language model pre-trained on a large Kyrgyz text corpus. It is designed for masked language modeling (MLM), text classification, and Kyrgyz NLP applications. Developed by Metino…
Downloads · 30 days
636
10% of all-time downloads
All-time downloads
6.2K
Public
Parameters
35.9M
143 MB on disk
Likes
6
Public
Click a slice to open those files.
.safetensors143 MB · 99%
From the Hugging Face model README
KyrgyzBert is a small-scale BERT-based language model pre-trained on a large Kyrgyz text corpus. It is designed for masked language modeling (MLM), text classification, and Kyrgyz NLP applications. Developed by Metinov Adilet, this model aims to enhance Kyrgyz NLP research and practical applications.
This model was trained on non-disclosable dataset containing over 1.5 million sentences. The dataset was tokenized using a metinovadilet/bert-kyrgyz-tokenizer.
You can load the model using Hugging Face's transformers library:
from transformers import BertTokenizerFast, BertForMaskedLM
import torch
# Load model and tokenizer
model_name = "metinovadilet/KyrgyzBert"
tokenizer = BertTokenizerFast.from_pretrained(model_name)
model = BertForMaskedLM.from_pretrained(model_name)
# Input text with [MASK] token
text = "Бул жерден [MASK] нерселерди таба аласыз."
# Tokenize input
inputs = tokenizer(text, return_tensors="pt")
# Model prediction
with torch.no_grad():
outputs = model(**inputs).logits
# Find masked token index
masked_index = (inputs.input_ids == tokenizer.mask_token_id).nonzero(as_tuple=True)[1].item()
# Get top 5 predictions for the masked token
probs = torch.softmax(outputs[0, masked_index], dim=-1)
top_k = torch.topk(probs, k=5) # Get top 5 predictions
# Decode predicted tokens
predicted_tokens = [tokenizer.decode([token_id]) for token_id in top_k.indices.tolist()]
# Print predictions
print(f"Top predictions for [MASK]: {', '.join(predicted_tokens)}")
This model was developed by Metinov Adilet. If you use this model, please consider citing our work.
This model is released under the Apache 2.0 License.
If you use this model in your research, please cite:
@misc{metinovadilet2025kyrgyzbert,
author = {Metinov Adilet},
title = {KyrgyzBert: A Small BERT Model for the Kyrgyz Language},
year = {2025},
howpublished = {Hugging Face},
url = {https://huggingface.co/metinovadilet/KyrgyzBert}
}
For questions, reach out to Metinov Adilet via Hugging Face or email - [email protected]