Downloads · 30 days
120
15% of all-time downloads
TylorShine/distilhubert-ft-japanese-50k
distilhubert-ft-japanese-50k is a feature extraction model from TylorShine. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as other.
Fine-tuned (more precisely, continue trained) 50k steps model on Japanese using the JVS corpus, Tsukuyomi-Chan corpus, Amitaro's ITA corpus V2.1, and recorded my own read ITA corpus.
Downloads · 30 days
120
15% of all-time downloads
All-time downloads
800
Public
Repo size
188 MB
Likes
2
Public
Click a slice to open those files.
.bin94 MB · 100%
From the Hugging Face model README
Fine-tuned (more precisely, continue trained) 50k steps model on Japanese using the JVS corpus, Tsukuyomi-Chan corpus, Amitaro's ITA corpus V2.1, and recorded my own read ITA corpus.
This checkpoint was used the JVS corpus when training. Please read and accept the terms of use
(This terms of use was also applies this checkpoint. This means also applies this "terms of use" when you use this checkpoint with another project etc...)
Original repos, Many thanks!:
S3PRL
Note: As same as the original, this model does not have a tokenizer as it was pretrained on audio alone. In order to use this model speech recognition, a tokenizer should be created and the model should be fine-tuned on labeled text data. Check out this blog for more in-detail explanation of how to fine-tune the model.
See this blog for more information on how to fine-tune the model. Note that the class Wav2Vec2ForCTC has to be replaced by HubertForCTC.
Note: This is not the best checkpoint and become more accurate with continued train, I think. I'll try to continue when I have a time.
■つくよみちゃんコーパス(CV.夢前黎)
https://tyc.rei-yumesaki.net/material/corpus/
あみたろの声素材工房
Thanks!