Downloads · 30 days
0
AmhWordPieceTokenizer
israel/AmhWordPieceTokenizer
AmhWordPieceTokenizer is a machine learning model from israel. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-4.0.
Access
Public
Updated Oct 17, 2022
Repo size
347 KB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json1.8 MB · 62%
At a glance
- License
- cc-by-4.0
- Access
- Public
- Created
- Oct 17, 2022
- Updated
- Oct 17, 2022
- SHA
- b3af0601
Model card
From the Hugging Face model README
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("israel/AmhWordPieceTokenizer")
encoding = tokenizer.encode("ኮሌጁ ቢያስተምርም ወደስራ የሚመድባቸው መንግስት ነው abcs")
encoding.tokens
- License
- cc-by-4.0
- Languages
- amh
- Created
- Oct 17, 2022
- Updated
- Oct 17, 2022