Downloads · 30 days
10
20% of all-time downloads
Storytelling-v1-13B-lora
Undi95/Storytelling-v1-13B-lora
Storytelling-v1-13B-lora is a machine learning model from Undi95. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as other.
The following bitsandbytes quantization config was used during training: - quantmethod: bitsandbytes - loadin8bit: True - loadin4bit: False - llmint8threshold: 6.0 - llmint8skipmodules: None - llmint8enablefp32cpuoffl…
All-time downloads
51
Public
Repo size
501 MB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.bin501 MB · 100%
At a glance
- Library
- peft
- License
- other
- Access
- Public
- Created
- Sep 7, 2023
- Updated
- Sep 19, 2023
- SHA
- 2f3e9641
Base models
Model card
From the Hugging Face model README
Training procedure
The following bitsandbytes quantization config was used during training:
- quant_method: bitsandbytes
- load_in_8bit: True
- load_in_4bit: False
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: True
- bnb_4bit_compute_dtype: bfloat16
Framework versions
- PEFT 0.5.0
I'm NOT the author of this work.
I cite anon :
Well, here it is. Storytelling Qlora. Trained on base llama2 13B but works flawlessly on other 13Bs. Idk about other sizes.
25MB of nsfw books, 60MB of sfwish ones.
No special formatting other than *** between chapters and ⁂ between books. Takes some text to get going but once you have some context filled, it feels way better for prose than raw llama or instruct models, imho.
Do whatever you want with it, I can't be bothered to maintain a HF page. WTFPL.
It's just shit from nai's archive
Credit to "anon49"
- Library
- peft
- License
- other
- Created
- Sep 7, 2023
- Updated
- Sep 19, 2023