Downloads · 30 days
0
causal-focus-bbpe16k-tokenizer
miguelcsx/causal-focus-bbpe16k-tokenizer
causal-focus-bbpe16k-tokenizer is a machine learning model from miguelcsx. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
Tokenizer-only repository for CausalFocus-GPTBERT-D256-BBPE16K.
Access
Public
Updated Jul 5, 2026
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json1.1 MB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- Jul 5, 2026
- Updated
- Jul 5, 2026
- SHA
- 5c95ae8f
Datasets
Model card
From the Hugging Face model README
CausalFocus BBPE16K Tokenizer
Tokenizer-only repository for CausalFocus-GPTBERT-D256-BBPE16K.
- family: byte-level BPE
- vocab size: 16000
- max sequence length used by release training: 512
- source corpus:
miguelcsx/babylm-corpus-cleaned
- License
- other
- Languages
- en
- Created
- Jul 5, 2026
- Updated
- Jul 5, 2026