Downloads · 30 days
697
45% of all-time downloads
Doctor-Shotgun/smol_llama-220M-GQA-32k-theta-sft-limarp
smol_llama-220M-GQA-32k-theta-sft-limarp is a text generation model from Doctor-Shotgun. Use it when you need the model to write or continue text. It is set up for transformers.
Experimental model meant to serve as a long-context speculative decoding model. This one is specifically for models trained on the LimaRP prompt format.
Downloads · 30 days
697
45% of all-time downloads
All-time downloads
1.5K
Public
Repo size
1.3 GB
Likes
0
Public
Click a slice to open those files.
.bin435 MB · 99%
From the Hugging Face model README
Experimental model meant to serve as a long-context speculative decoding model. This one is specifically for models trained on the LimaRP prompt format.
Created using Doctor-Shotgun/smol_llama-220M-GQA-32k-theta-sft and finetuning at 32768 context length on the LimaRP dataset.
This variant uses the rope theta (rope frequency base) method for context extension.
The trained instruction format is LimaRP Alpaca:
### Instruction:
Character's Persona: {bot character description}
User's Persona: {user character description}
Scenario: {what happens in the story}
Play the role of Character. Taking the above information into consideration, you must engage in a roleplaying chat with User below this line. Do not write dialogues and narration for User.
### Input:
User: {utterance}
### Response:
Character: {utterance}
### Input
User: {utterance}
### Response:
Character: {utterance}
(etc.)