Downloads · 30 days
0
asahala/BabyLemmatizer-Babylonian-1st
BabyLemmatizer-Babylonian-1st is a machine learning model from asahala. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Total data set size ca. 1.3M words (including lacunae). Consists of all Oracc texts labeled as any variant of Babylonian or Akkadian in the first millennium BCE. Neo-Assyrian excluded. OOV rate is fairly low but the d…
Downloads · 30 days
0
Access
Public
Updated Sep 7, 2023
Repo size
257 MB
Likes
0
Public
Click a slice to open those files.
.gz257 MB · 100%
From the Hugging Face model README
Total data set size ca. 1.3M words (including lacunae). Consists of all Oracc texts labeled as any variant of Babylonian or Akkadian in the first millennium BCE. Neo-Assyrian excluded. OOV rate is fairly low but the data set is very varied and comprises all different text genres.
See model Babylonian-2nd for Middle Babylonian (and in general second millennium Babylonian).
Neural Net Evaluation
COMPONENT AVG CI MODEL0
POS-tagger 96.84 ±0.00 96.84
Lemmatizer 95.23 ±0.00 95.23
Combined 93.91 ±0.00 93.91
POS-tagger OOV 87.41 ±0.00 87.41
Lemmatizer OOV 71.78 ±0.00 71.78
Combined OOV 69.63 ±0.00 69.63
-----------------------------------------------
OOV input rate 6.63 6.63
Post-correct Evaluation
COMPONENT AVG CI MODEL0
POS-tagger 96.84 ±0.00 96.84
Lemmatizer 95.36 ±0.00 95.36
Combined 94.04 ±0.00 94.04
POS-tagger OOV 87.41 ±0.00 87.41
Lemmatizer OOV 71.78 ±0.00 71.78
Combined OOV 69.63 ±0.00 69.63
-----------------------------------------------
OOV input rate 6.63 6.63