Downloads · 30 days
13
2% of all-time downloads
rag-token-bart-base
laituan245/rag-token-bart-base
rag-token-bart-base is a machine learning model from laituan245. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This model is a non-finetuned RAG-Token model and was created as follows:
All-time downloads
797
Public
Repo size
2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin994 MB · 100%
At a glance
- Library
- transformers
- Model type
- rag
- Access
- Public
- Created
- May 24, 2022
- Updated
- May 24, 2022
- SHA
- bb99d38d
Model card
From the Hugging Face model README
This model is a non-finetuned RAG-Token model and was created as follows:
from transformers import RagTokenizer, RagTokenForGeneration, AutoTokenizer
model = RagTokenForGeneration.from_pretrained_question_encoder_generator(
"facebook/dpr-question_encoder-single-nq-base",
"facebook/bart-base"
)
question_encoder_tokenizer = AutoTokenizer.from_pretrained("facebook/dpr-question_encoder-single-nq-base")
generator_tokenizer = AutoTokenizer.from_pretrained("facebook/bart-base")
tokenizer = RagTokenizer(question_encoder_tokenizer, generator_tokenizer)
model.config.use_dummy_dataset = True
model.config.index_name = "exact"
model.save_pretrained("./")
tokenizer.save_pretrained("./")
- Library
- transformers
- Type
- rag
- Created
- May 24, 2022
- Updated
- May 24, 2022