Downloads · 30 days
16
3% of all-time downloads
fractalego/samsumbot
samsumbot is a text generation model from fractalego. Use it when you need the model to write or continue text. It is set up for transformers.
This is a model fine-tuned on the SamSum dataset. However, instead of training the system to summarize conversations, the model is trained to predict a conversation given a summary. The prompt needs to be in the follo…
Downloads · 30 days
16
3% of all-time downloads
All-time downloads
550
Public
Repo size
12.5 GB
Likes
0
Public
Click a slice to open those files.
.bin6.2 GB · 100%
From the Hugging Face model README
This is a model fine-tuned on the SamSum dataset. However, instead of training the system to summarize conversations, the model is trained to predict a conversation given a summary. The prompt needs to be in the following form
A partial summary of the conversation is:
{summary}
With the dialogue being:
{dialogue}
where {summary} is a text as in
John went out to buy groceries. He meets Jane on the way and they talk about the weather.
and the {dialogue} needs to be structured with speaking lines preceded by the speaking character
John: Oh hi Jane.
Jane: Nice to see you?
John: The weather looks nice today
Jane: [PREDICTION]
The system is based on the GPTJ-6B by EleutherAI, quantized by Hivemind. It has been fine-tuned according to the LoRa method. A simple back-end is available in this repo, where the model is served using Torchserve. A terminal-like front-end interface is available here. This interface is the one used in my website http://fractalego.io.