Downloads · 30 days
21
5% of all-time downloads
iamplus/mpt-30b-v4
mpt-30b-v4 is a text generation model from iamplus. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
21
5% of all-time downloads
All-time downloads
386
Public
Repo size
120 GB
Likes
0
Public
Click a slice to open those files.
.bin59.9 GB · 100%
From the Hugging Face model README
Base Model : mosaicml/mpt-30b
Tool : MosaicML's llm-foundry (https://github.com/mosaicml/llm-foundry)
Dataset : Entire flan1m-GPT4 dataset
Config yaml with Model Params : https://huggingface.co/iamplus/mpt-30b-v4/blob/main/mpt-30b_v4.yaml
Description : mosaicml/mpt-30b -> Finetuning on (Entire flan3m-GPT3.5 dataset for 4 epochs)
Prompt Format :
<system>: [system prompt]
<human>: [question]
<bot>: