Downloads · 30 days
8
13% of all-time downloads
tsukasa-120b-qlora-gptq
ludis/tsukasa-120b-qlora-gptq
tsukasa-120b-qlora-gptq is a text generation model from ludis. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
63
Public
Repo size
59.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors59.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Nov 29, 2023
- Updated
- Feb 1, 2024
- SHA
- 4ca86f3f
Try a prompt
Model card
From the Hugging Face model README
Gen Settings & Prompting
https://rentry.org/tsukasamodel
GPTQ
2048 sequence length
wikitext
Training
axolotl was used for training on a 8x nvidia a100 gpu cluster.
the a100 GPU cluster has been graciously provided by lloorree.
rank 8 qlora (all modules) tune
base model alpindale/goliath-120b tuned on koishi commit 6e675d1 for one epoch
then tuned on pippa 6412b0c for one epoch (metharme completion)
then tuned on limarp (without ponyville, lolicit, all the fallen, and eka's portal subsets) Version 2023-10-19 for 2 epochs in metharme completion format
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Nov 29, 2023
- Updated
- Feb 1, 2024