Downloads · 30 days
20
1% of all-time downloads
GALAXY-16B-v1.0
TeeZee/GALAXY-16B-v1.0
GALAXY-16B-v1.0 is a text generation model from TeeZee. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
1.8K
Public
Parameters
16B
31.9 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors31.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Apr 22, 2024
- Updated
- Apr 24, 2024
- SHA
- a5585d43
Try a prompt
Model card
From the Hugging Face model README
GALAXY-16B-v1.0
Technical notes
- 72 layers,DUS procedure, mistral(32)->SOLAR(48)->GALAXY(72)
- 16B parameters
- model created as an extension of depth upscaling procedure used for SOLAR by upstage
Results
- model can and will produce NSFW content
- waiting for eval results
Prompt template
- Alpaca
- chat template is embedded in tokenizer config, should load automatically
Context size
- 4096
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel: <a href="https://www.buymeacoffee.com/TeeZee" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Apr 22, 2024
- Updated
- Apr 24, 2024