Downloads · 30 days
12
24% of all-time downloads
RichardErkhov/KnutJaegersberg_-_Qwen-1_8B-Llamafied-4bits
KnutJaegersberg_-_Qwen-1_8B-Llamafied-4bits is a text generation model from RichardErkhov. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
12
24% of all-time downloads
All-time downloads
50
Public
Parameters
1.9B
1.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1.9 GB · 99%
How the weights are stored.
U81.2B · 65%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Qwen-1_8B-Llamafied - bnb 4bits
Their non-commercial research license applies.
I used this script to make the model and used the tokenizer of CausalLM, as suggested in the comments of the script.
https://github.com/hiyouga/LLaMA-Factory/blob/main/tests/llamafy_qwen.py