Downloads · 30 days
0
hw4_tokenizer_20k
alexgichamba/hw4_tokenizer_20k
hw4_tokenizer_20k is a machine learning model from alexgichamba. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
A tokenizer with a vocab size of 20k for Intro to Deep Learning Homework 4 on Language Modelling and Automatic Speech Recognition.
Access
Public
Updated Nov 12, 2024
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json1.7 MB · 90%
At a glance
- Library
- transformers
- Access
- Public
- Created
- Oct 22, 2024
- Updated
- Nov 12, 2024
- SHA
- e4f58ba9
Model card
From the Hugging Face model README
Tokenizer
A tokenizer with a vocab size of 20k for Intro to Deep Learning Homework 4 on Language Modelling and Automatic Speech Recognition.
The tokenizer was trained on LibriSpeech LM text
- Library
- transformers
- Created
- Oct 22, 2024
- Updated
- Nov 12, 2024