Downloads · 30 days
7
1% of all-time downloads
gpt2-base-zh-hk
jed351/gpt2-base-zh-hk
gpt2-base-zh-hk is a feature extraction model from jed351. Use it when you need embeddings to search or compare text. It is set up for transformers.
This model has not been trained on any Cantonese material.
All-time downloads
715
Public
Repo size
843 MB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin421 MB · 100%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Feb 2, 2023
- Updated
- Feb 2, 2023
- SHA
- f6300106
Model card
From the Hugging Face model README
This model has not been trained on any Cantonese material.
It is simply a base model in which the embeddings and tokenizer were patched with Cantonese characters. One can find the original model gpt2-tiny-chinese.
I used this repo to identify missing Cantonese characters
My forked and modified version
After identifying the missing characters, the Huggingface library provides very high level API to modify the tokenizer and embeddings.
Download a tokenizer and a model from the Huggingface library. Then:
tokenizer.add_tokens("your new tokens")
model.resize_token_embeddings(len(tokenizer))
tokenizer.push_to_hub("your model name")
- Task
- Feature Extraction
- Library
- transformers
- Type
- gpt2
- Created
- Feb 2, 2023
- Updated
- Feb 2, 2023