Skip to content

tahaenesaslanturk

ts-corpus-bpe-256k-cased

tahaenesaslanturk/ts-corpus-bpe-256k-cased

ts-corpus-bpe-256k-cased is a machine learning model from tahaenesaslanturk. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.

This repository hosts a Byte Pair Encoding (BPE) tokenizer with a vocabulary size of 256,000, trained cased using several datasets from the TS Corpus website. The BPE method is particularly effective for languages lik…

Downloads · 30 days

0

Access

Public

Updated Apr 30, 2024

Repo size

13.6 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.json13.6 MB · 100%

At a glance

License
mit
Access
Public
Created
Apr 30, 2024
Updated
Apr 30, 2024
SHA
e2d87828
License
mit
Created
Apr 30, 2024
Updated
Apr 30, 2024