Downloads · 30 days
213
37% of all-time downloads
bitnet-5B-v0
Ttimofeyka/bitnet-5B-v0
bitnet-5B-v0 is a text generation model from Ttimofeyka. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This model is my starting point zero for trying to finetune model based on bitnet architecture. I just added new layers with random weights to the finished model.
All-time downloads
569
Public
Parameters
5.1B
13.6 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors13.6 GB · 100%
Parameter types
How the weights are stored.
F163.3B · 66%
Try a prompt
Model card
From the Hugging Face model README
This model is my starting point zero for trying to finetune model based on bitnet architecture. I just added new layers with random weights to the finished model.
Maybe it can be broken.
It is not recommended for use: the results show an improvement in test results at the margin of error.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Created
- Jun 25, 2024
- Updated
- Jun 25, 2024