Downloads · 30 days
16
4% of all-time downloads
BigStationW/Airoboros-13b-gpt4-StoryTelling-GPTQ-32g-ao-ts
Airoboros-13b-gpt4-StoryTelling-GPTQ-32g-ao-ts is a text generation model from BigStationW. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This model is a merge between the finetuned model named airoboros-gpt4-1.4 and a StoryTelling Lora
Downloads · 30 days
16
4% of all-time downloads
All-time downloads
400
Public
Repo size
8 GB
Likes
5
Public
Click a slice to open those files.
.safetensors8 GB · 100%
From the Hugging Face model README
This model is a merge between the finetuned model named airoboros-gpt4-1.4 and a StoryTelling Lora
https://huggingface.co/jondurbin/airoboros-13b-gpt4-1.4 https://huggingface.co/GamerUntouch/Storytelling-LLaMa-LoRAs
Airoboros is a great base model as it understands the requets well and has a great english prose. The problem was that for Storytelling purposes, it was really blank and the model never added something new to the table. Mixing this finetuned model with a Storytelling Lora really made it more creative and interesting, I hope you'll enjoy it :)
This gptq safetensor has all the implementations in it (true_sequential + act_order + groupsize 32)
Run it with exllama_hf, this marvelous feature can load everything!