Downloads · 30 days
16
7% of all-time downloads
LumiOpen/llama-hpltv2-edu-classifier-xlm-roberta-large-tat-Cyrl
llama-hpltv2-edu-classifier-xlm-roberta-large-tat-Cyrl is a machine learning model from LumiOpen. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is a classifier for judging the educational content of Tatar (tat-Cyrl) web pages. It was developed to filter educational content from HPLT v2 and was trained on 450k annotations generated by LLama3.3-70B-instruct.
Downloads · 30 days
16
7% of all-time downloads
All-time downloads
238
Public
Parameters
560M
2.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.2 GB · 99%
From the Hugging Face model README
This is a classifier for judging the educational content of Tatar (tat-Cyrl) web pages. It was developed to filter educational content from HPLT v2 and was trained on 450k annotations generated by LLama3.3-70B-instruct. The web pages were sampled randomly from Tatar subset of the corpus.
To load the Llama-HPLT-Edu classifier, use the following code:
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("LumiOpen/llama-hpltv2-edu-classifier-xlm-roberta-large-tat-Cyrl")
model = AutoModelForSequenceClassification.from_pretrained("LumiOpen/llama-hpltv2-edu-classifier-xlm-roberta-large-tat-Cyrl")
text = "I'm non-educational web page containing nothing useful"
inputs = tokenizer(text, return_tensors="pt", padding="longest", truncation=True)
outputs = model(**inputs)
logits = outputs.logits.squeeze(-1).float().detach().numpy()
score = logits.item()
result = {
"text": text,
"score": score,
"int_score": int(round(max(0, min(score, 5)))),
}
print(result)
#results from a model trained with Welsh annotations
#{'text': "I'm non-educational web page containing nothing useful", 'score': 0.8145455718040466, 'int_score': 1}
#{'text': 'what are most common animals found in farm? there are cows, sheeps', 'score': 1.6858888864517212, 'int_score': 2}
precision recall f1-score support
0 0.70 0.45 0.54 7676
1 0.55 0.73 0.63 10516
2 0.44 0.47 0.45 4315
3 0.34 0.27 0.30 1540
4 0.57 0.17 0.26 825
5 0.60 0.23 0.33 128
accuracy 0.55 25000
macro avg 0.53 0.39 0.42 25000
weighted avg 0.56 0.55 0.54 25000
Preprint coming soon. If you need to cite this work, please use the citation below:
@misc {llama_hplt_edu_classifiers_2025,
author = { Tarkka, Otto, Reunamo, Akseli, Vitiugin, Fedor and Pyysalo, Sampo }
title = { Llama-HPLT-edu classifiers },
year = 2025,
url = {https://huggingface.co/collections/LumiOpen/hplt-edu-classifiers-68a85a78f9710426320e7cbb},
publisher = { Hugging Face }
}