Downloads · 30 days
44
0% of all-time downloads
albert_chinese_small
clue/albert_chinese_small
albert_chinese_small is a machine learning model from clue. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
Language model: albert-small Model size: 18.5M Language: Chinese Training data: CLUECorpusSmall Eval data: CLUE dataset
All-time downloads
15.1K
Public
Repo size
38.6 MB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.bin19.3 MB · 99%
At a glance
- Library
- transformers
- Model type
- albert
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Dec 11, 2020
- SHA
- f2fc21cd
Model card
From the Hugging Face model README
albert_chinese_small
Overview
Language model: albert-small Model size: 18.5M Language: Chinese Training data: CLUECorpusSmall Eval data: CLUE dataset
Results
For results on downstream tasks like text classification, please refer to this repository.
Usage
**NOTE:**Since sentencepiece is not used in albert_chinese_small model, you have to call BertTokenizer instead of AlbertTokenizer !!!
import torch
from transformers import BertTokenizer, AlbertModel
tokenizer = BertTokenizer.from_pretrained("clue/albert_chinese_small")
albert = AlbertModel.from_pretrained("clue/albert_chinese_small")
About CLUE benchmark
Organization of Language Understanding Evaluation benchmark for Chinese: tasks & datasets, baselines, pre-trained Chinese models, corpus and leaderboard.
Github: https://github.com/CLUEbenchmark Website: https://www.cluebenchmarks.com/
- Library
- transformers
- Type
- albert
- Languages
- zh
- Created
- Mar 2, 2022
- Updated
- Dec 11, 2020