Downloads · 30 days
19
4% of all-time downloads
CDial-GPT2-LCCC-Base-copy
huolongguo10/CDial-GPT2-LCCC-Base-copy
CDial-GPT2-LCCC-Base-copy is a machine learning model from huolongguo10. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
This project provides a large-scale Chinese GPT model pre-trained on the dataset LCCC.
All-time downloads
491
Public
Repo size
789 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin395 MB · 100%
At a glance
- Library
- transformers
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- Mar 5, 2023
- Updated
- Mar 24, 2023
- SHA
- 73b41e8d
Datasets
Model card
From the Hugging Face model README
Chinese pre-trained dialogue model (CDial-GPT)
This project provides a large-scale Chinese GPT model pre-trained on the dataset LCCC.
We present a series of Chinese GPT model that are first pre-trained on a Chinese novel dataset and then post-trained on our LCCC dataset.
Similar to TransferTransfo, we concatenate all dialogue histories into one context sentence, and use this sentence to predict the response. The input of our model consists of word embedding, speaker embedding, and positional embedding of each word.
Paper: A Large-Scale Chinese Short-Text Conversation Dataset
How to use
from transformers import OpenAIGPTLMHeadModel, GPT2LMHeadModel, BertTokenizer
import torch
tokenizer = BertTokenizer.from_pretrained("thu-coai/CDial-GPT2_LCCC-base")
model = GPT2LMHeadModel.from_pretrained("thu-coai/CDial-GPT2_LCCC-base")
For more details, please refer to our repo. on github.
- Library
- transformers
- Type
- gpt2
- License
- mit
- Created
- Mar 5, 2023
- Updated
- Mar 24, 2023