Downloads · 30 days
31
6% of all-time downloads
Goliath-longLORA-120b-rope8-32k-fp16
grimulkan/Goliath-longLORA-120b-rope8-32k-fp16
Goliath-longLORA-120b-rope8-32k-fp16 is a text generation model from grimulkan. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
This is an interleaved merge of Xwin-longLORA-70b-rope8-32k-fp16 and Euryale-1.3-longLORA-70b-rope8-32k-fp16, using the same merge formula as alpindale's goliath-120b.
All-time downloads
493
Public
Parameters
118B
235 GB on disk
Likes
7
Public
Repo makeup
Click a slice to open those files.
.safetensors235 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- llama
- Access
- Public
- Created
- Jan 24, 2024
- Updated
- Jan 27, 2024
- SHA
- c9111dd1
Try a prompt
Model card
From the Hugging Face model README
This is an interleaved merge of Xwin-longLORA-70b-rope8-32k-fp16 and Euryale-1.3-longLORA-70b-rope8-32k-fp16, using the same merge formula as alpindale's goliath-120b.
There is no additional fine-tuning. The resulting model seems to not be broken... you can test whether it is truly the original model + 32K capability (use linear rope scaling 8).
ChuckMcSneed did a benchmark here, indicating 30% degradation with 8x the context length.
A 6-bit EXL2 quantization is available here. More EXL2 quants here, thanks to aikitoria.
See this discussion for how the original 70B merges were created with longLORA.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Created
- Jan 24, 2024
- Updated
- Jan 27, 2024