Downloads · 30 days
18
3% of all-time downloads
gpt2-tiny-zh-hk
jed351/gpt2-tiny-zh-hk
gpt2-tiny-zh-hk is a feature extraction model from jed351. Use it when you need embeddings to search or compare text. It is set up for transformers.
This model has not been trained on any Cantonese material.
All-time downloads
552
Public
Repo size
102 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin50.8 MB · 99%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Jan 25, 2023
- Updated
- Jan 27, 2023
- SHA
- f6a57de0
Model card
From the Hugging Face model README
This model has not been trained on any Cantonese material.
It is simply a base model in which the embeddings and tokenizer were patched with Cantonese characters. One can find the original model gpt2-tiny-chinese.
I used this repo to identify missing Cantonese characters
My forked and modified version
After identifying the missing characters, the Huggingface library provides very high level API to modify the tokenizer and embeddings.
Download a tokenizer and a model from the Huggingface library. Then:
tokenizer.add_tokens("your new tokens")
model.resize_token_embeddings(len(tokenizer))
tokenizer.push_to_hub("your model name")
- Task
- Feature Extraction
- Library
- transformers
- Type
- gpt2
- Created
- Jan 25, 2023
- Updated
- Jan 27, 2023