Downloads · 30 days
119
0% of all-time downloads
ScarletPajama-3B-HF
Fredithefish/ScarletPajama-3B-HF
ScarletPajama-3B-HF is a text generation model from Fredithefish. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Introducing ScarletPajama: a language model that has been finetuned on the ShareGPT dataset. Built upon the robust RedPajama-INCITE-Chat-3b architecture. <br The original ShareGPT dataset consisted of 53k pairs of con…
All-time downloads
59.9K
Public
Repo size
11.4 GB
Likes
9
Public
Repo makeup
Click a slice to open those files.
.bin5.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- gpt_neox
- Access
- Public
- Created
- May 22, 2023
- Updated
- Jun 11, 2023
- SHA
- 9dd07308
Try a prompt
Model card
From the Hugging Face model README
ScarletPajama
Introducing ScarletPajama: a language model that has been finetuned on the ShareGPT dataset. Built upon the robust RedPajama-INCITE-Chat-3b architecture. <br> The original ShareGPT dataset consisted of 53k pairs of conversational exchanges. In order to optimize the training process, the dataset was converted to the appropriate format and filtered to remove long texts. The resulting filtered version of ShareGPT contains 22k pairs, ensuring a more focused and efficient training process.
Model Details
- Model Name: ScarletPajama
- Base Model: RedPajama-INCITE-Chat-3b
- Dataset: <a href="https://huggingface.co/datasets/Fredithefish/ShareGPT-Unfiltered-RedPajama-Chat-format/blob/main/ShareGPT-22k.jsonl">ShareGPT-22K</a>
- Fine-tuning Epochs: 2
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_neox
- License
- apache-2.0
- Created
- May 22, 2023
- Updated
- Jun 11, 2023