Downloads · 30 days
19
1% of all-time downloads
llama33b-16k
chargoddard/llama33b-16k
llama33b-16k is a text generation model from chargoddard. Use it when you need the model to write or continue text. It is set up for transformers.
LLaMA 33b finetuned on wikitextdocumentlevel with a linear ROPE scaling of 8, for a 16k token context length. This is a merged version of llama33b-16k-qlora.
All-time downloads
1.3K
Public
Repo size
130 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin65.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Jul 18, 2023
- Updated
- Jul 18, 2023
- SHA
- 1679bac3
Try a prompt
Model card
From the Hugging Face model README
LLaMA 33b finetuned on wikitext_document_level with a linear ROPE scaling of 8, for a 16k token context length.
This is a merged version of llama33b-16k-qlora.
Note that this is not an instruct model - this is base LLaMA with an extended sequence length.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Jul 18, 2023
- Updated
- Jul 18, 2023