Downloads · 30 days
23
24% of all-time downloads
SHRDFU-7b-delta
maldv/SHRDFU-7b-delta
SHRDFU-7b-delta is a text generation model from maldv. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
- Developed by: maldv - License: cc-by-nc-4.0 - Finetuned from model: ammarali32/multiversemodel - Methodology: Peft to train; extending intelligence and problem solving w/ crabcanon
All-time downloads
95
Public
Parameters
7.2B
14.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- mistral
- Access
- Public
- Created
- Mar 10, 2024
- Updated
- Mar 10, 2024
- SHA
- bff40005
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
SHRDFU-7b Δ
- Developed by: maldv
- License: cc-by-nc-4.0
- Finetuned from model: ammarali32/multi_verse_model
- Methodology: Peft to train; extending intelligence and problem solving w/ crabcanon
As I work on understanding how to layer information in to the model, this model used no conditioning and even with low LR's, had quite a sharp graph. It definitely inherited the style of the source.
I had been experimenting in this series with wrapping each paragraph or turn with <s></s> bos/eos tokens. This may be semi-compatible with instruct, but is incompatible with alpaca and chatml. Good to know.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- cc-by-nc-4.0
- Languages
- en
- Created
- Mar 10, 2024
- Updated
- Mar 10, 2024