Downloads · 30 days
298
44% of all-time downloads
Ttimofeyka/bitnet-5B-v1
bitnet-5B-v1 is a text generation model from Ttimofeyka. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
I redesigned mergekit so that I could merge the bitnet 3B model (unlike version v0, where I did merge via PyTorch).
Downloads · 30 days
298
44% of all-time downloads
All-time downloads
677
Public
Parameters
4.6B
9.1 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors9.1 GB · 100%
From the Hugging Face model README
I redesigned mergekit so that I could merge the bitnet 3B model (unlike version v0, where I did merge via PyTorch).
In theory, this is compatible with quantization via llama.cpp , but tests are needed.