Downloads · 30 days
0
BabyLemmatizer-Sumerian
asahala/BabyLemmatizer-Sumerian
BabyLemmatizer-Sumerian is a machine learning model from asahala. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
These models use indexed logo-syllabic tokenization and require BabyLemmatizer 2.1. Consists of two models, sumerian-lit for literary Sumerian and sumerian-adm for Administrative Sumerian.
Access
Public
Updated Sep 7, 2023
Repo size
441 MB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gz441 MB · 100%
At a glance
- Access
- Public
- Created
- Sep 7, 2023
- Updated
- Sep 7, 2023
- SHA
- 17bc223c
Model card
From the Hugging Face model README
Sumerian models for BabyLemmatizer
These models use indexed logo-syllabic tokenization and require BabyLemmatizer 2.1. Consists of two models, sumerian-lit for literary Sumerian and sumerian-adm for Administrative Sumerian.
sumerian-adm consists of all Sumerian Early Dynastic, Old Babylonian, Old Akkadian, Ebla and Lagaš II administrative texts in Oracc's ePSD2 corpus, consisting 570k words.
sumerian-lit consists of all Sumerian literary texts from Oracc comprising 268k words.
Evaluation results for administrative model
Neural Net Evaluation
COMPONENT AVG CI MODEL0
POS-tagger 96.48 ±0.00 96.48
Lemmatizer 95.39 ±0.00 95.39
Combined 94.42 ±0.00 94.42
POS-tagger OOV 82.03 ±0.00 82.03
Lemmatizer OOV 71.87 ±0.00 71.87
Combined OOV 68.00 ±0.00 68.00
-----------------------------------------------
OOV input rate 5.44 5.44
Post-correct Evaluation
COMPONENT AVG CI MODEL0
POS-tagger 96.48 ±0.00 96.48
Lemmatizer 95.42 ±0.00 95.42
Combined 94.44 ±0.00 94.44
POS-tagger OOV 82.03 ±0.00 82.03
Lemmatizer OOV 71.87 ±0.00 71.87
Combined OOV 68.00 ±0.00 68.00
-----------------------------------------------
OOV input rate 5.44 5.44
Evaluation results for literary model
Neural Net Evaluation
COMPONENT AVG CI MODEL0
POS-tagger 94.00 ±0.00 94.00
Lemmatizer 93.71 ±0.00 93.71
Combined 91.37 ±0.00 91.37
POS-tagger OOV 82.61 ±0.00 82.61
Lemmatizer OOV 80.87 ±0.00 80.87
Combined OOV 74.54 ±0.00 74.54
-----------------------------------------------
OOV input rate 19.04 19.04
Post-correct Evaluation
COMPONENT AVG CI MODEL0
POS-tagger 94.00 ±0.00 94.00
Lemmatizer 93.70 ±0.00 93.70
Combined 91.36 ±0.00 91.36
POS-tagger OOV 82.61 ±0.00 82.61
Lemmatizer OOV 80.87 ±0.00 80.87
Combined OOV 74.54 ±0.00 74.54
-----------------------------------------------
OOV input rate 19.04 19.04
- Created
- Sep 7, 2023
- Updated
- Sep 7, 2023