Downloads · 30 days
6
16% of all-time downloads
Bert2gpt_Liputan6_100k_8epoch
Willy030125/Bert2gpt_Liputan6_100k_8epoch
Bert2gpt_Liputan6_100k_8epoch is a machine learning model from Willy030125. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as cc.
Dataset source: https://huggingface.co/datasets/fajrikoto/idliputan6 <br Model used for Fine Tuning (Encoder):<br https://huggingface.co/cahya/bert-base-indonesian-1.5G <br Model used for Fine Tuning (Decoder):<br htt…
All-time downloads
37
Public
Parameters
263M
1.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.1 GB · 100%
At a glance
- Library
- transformers
- License
- cc
- Model type
- encoder-decoder
- Access
- Public
- Created
- Jul 11, 2024
- Updated
- Jul 16, 2024
- SHA
- 7d8bd3c1
Model card
From the Hugging Face model README
Bert2gpt (Encoder-Decoder) on Liputan6 100k dataset
Dataset source: https://huggingface.co/datasets/fajrikoto/id_liputan6 <br> Model used for Fine Tuning (Encoder):<br> https://huggingface.co/cahya/bert-base-indonesian-1.5G <br> Model used for Fine Tuning (Decoder):<br> https://huggingface.co/cahya/gpt2-small-indonesian-522M <br><br> Trained on 1x3090 @ 8 epoch (EarlyStopping Callbacks)
Train logs, metrics, and params: https://wandb.ai/willy030125/huggingface/runs/9nt3z9dh <br> https://www.comet.com/willy030125/huggingface/404a9a8abbd84ed5931ff944746df83c <br> Eval results and Perplexity: <a href="https://huggingface.co/Willy030125/Bert2gpt_Liputan6_100k_8epoch/blob/main/eval_results.json">eval_results.json</a><br>
Usage:
from transformers import BertTokenizer, GPT2Tokenizer, EncoderDecoderModel
encoder_tokenizer = BertTokenizer.from_pretrained("cahya/bert-base-indonesian-1.5G")
decoder_tokenizer = GPT2Tokenizer.from_pretrained("cahya/gpt2-small-indonesian-522M")
model = EncoderDecoderModel.from_pretrained("Willy030125/Bert2gpt_Liputan6_100k_8epoch")
- Library
- transformers
- Type
- encoder-decoder
- License
- cc
- Created
- Jul 11, 2024
- Updated
- Jul 16, 2024