Downloads · 30 days
3
7% of all-time downloads
facebook_xlm-roberta-base__trimm_vocab__bf16
Symato/facebook_xlm-roberta-base__trimm_vocab__bf16
facebook_xlm-roberta-base__trimm_vocab__bf16 is a machine learning model from Symato. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
44
Public
Parameters
122M
244 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors244 MB · 99%
At a glance
- Model type
- xlm-roberta
- Access
- Public
- Created
- Oct 18, 2024
- Updated
- Oct 18, 2024
- SHA
- 17097afe
Model card
From the Hugging Face model README
model FacebookAI/xlm-roberta-base
params 278043648
embeds 192001536
torch.bfloat16
model Symato/facebook_xlm-roberta-base__trimm_vocab__bf16
params 121775616
embeds 35733504
torch.float16
Giảm vocab size từ 250002 / 46000 => 5.43 lần
=> embeddings giảm từ 192m xuống 36m
=> model size giảm từ 270m xuống 121m (còn 45%)
Phở bert large 370M, phở bert base 135M
- Type
- xlm-roberta
- Created
- Oct 18, 2024
- Updated
- Oct 18, 2024