Downloads · 30 days
32
0% of all-time downloads
ernie-gram-zh
nghuyong/ernie-gram-zh
ernie-gram-zh is a feature extraction model from nghuyong. Use it when you need embeddings to search or compare text. It is set up for transformers.
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding
All-time downloads
31K
Public
Repo size
1.2 GB
Likes
5
Public
Repo makeup
Click a slice to open those files.
.bin400 MB · 100%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Apr 3, 2022
- Updated
- Aug 22, 2022
- SHA
- def93d84
Model card
From the Hugging Face model README
ERNIE-Gram-zh
Introduction
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding
More detail: https://arxiv.org/abs/2010.12148
Released Model Info
| Model Name | Language | Model Structure |
|---|---|---|
| ernie-gram-zh | Chinese | Layer:12, Hidden:768, Heads:12 |
This released Pytorch model is converted from the officially released PaddlePaddle ERNIE model and a series of experiments have been conducted to check the accuracy of the conversion.
- Official PaddlePaddle ERNIE repo: https://github.com/PaddlePaddle/PaddleNLP/blob/develop/paddlenlp/transformers/ernie_gram/modeling.py
- Pytorch Conversion repo: https://github.com/nghuyong/ERNIE-Pytorch
How to use
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("nghuyong/ernie-gram-zh")
model = AutoModel.from_pretrained("nghuyong/ernie-gram-zh")
- Task
- Feature Extraction
- Library
- transformers
- Type
- bert
- Languages
- zh
- Created
- Apr 3, 2022
- Updated
- Aug 22, 2022