Downloads · 30 days
236
1% of all-time downloads
bluemoonrp-13b
reeducator/bluemoonrp-13b
bluemoonrp-13b is a text generation model from reeducator. Use it when you need the model to write or continue text. It is set up for transformers.
Bluemoon roleplay finetune of LLaMA 13B (2 roleplayers only).
All-time downloads
32.7K
Public
Repo size
104 GB
Likes
40
Public
Repo makeup
Click a slice to open those files.
.bin61 GB · 89%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- May 4, 2023
- Updated
- May 24, 2023
- SHA
- db22104a
Try a prompt
Model card
From the Hugging Face model README
General
Bluemoon roleplay finetune of LLaMA 13B (2 roleplayers only).
Models
Two models are provided, labeled (1) 4k-epoch6 and (2) epoch3 (other branch). In case of the (1), the training is extended over more epochs to reduce the high training loss observed in (2). This release also tests a longer 4k context token size achieved with AliBi.
GGML 4-bit for llama.cpp<br/>
- ggml-bluemoonrp-13b-4k-epoch6-q5_0.bin
- ggml-bluemoonrp-13b-epoch3-q5_0.bin
GPTQ 4-bit CUDA:<br/>
- bluemoonrp-13b-4k-epoch6-4bit-128g.safetensors
- bluemoonrp-13b-epoch3-4bit-128g.safetensors
Remarks
This model has been trained using the following prompt (Vicuna 1.1 format):
A transcript of a roleplay between two players, LEAD and ASSOCIATE. LEAD sets up a scenario and the characters, from which ASSOCIATE then assumes a character role and continues the story for that role in response to description given by LEAD. The story and characters are developed by exchange of detailed event descriptions and character dialogs, successively given by both LEAD and ASSOCIATE.
LEAD: [role1 message]
ASSOCIATE: [role2 message]</s>
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Languages
- en
- Created
- May 4, 2023
- Updated
- May 24, 2023