Downloads · 30 days
18
1% of all-time downloads
omega-3b
winglian/omega-3b
omega-3b is a text generation model from winglian. Use it when you need the model to write or continue text. It is set up for transformers.
<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/
All-time downloads
1.5K
Public
Repo size
47.2 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.bin5.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- mixformer-sequential
- Access
- Public
- Created
- Sep 15, 2023
- Updated
- Sep 16, 2023
- SHA
- 620af193
Try a prompt
Model card
From the Hugging Face model README
Omega 2.6B
This model is derived from phi 1.3B using layer stacking techniques to double the number of hidden layers in the model. The model was then trained for 1 epoch on data from tiny-textbooks and tiny-lessons.
Training
- Task
- Text Generation
- Library
- transformers
- Type
- mixformer-sequential
- Languages
- en
- Created
- Sep 15, 2023
- Updated
- Sep 16, 2023