Downloads · 30 days
14
16% of all-time downloads
qikp/kite-6.5-15m
kite-6.5-15m is a text generation model from qikp. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc0-1.0.
🎉 You are looking at Kite 6.5, which uses Ultra-FineWeb!
Downloads · 30 days
14
16% of all-time downloads
All-time downloads
88
Public
Parameters
15M
59.8 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors59.8 MB · 99%
From the Hugging Face model README
🎉 You are looking at Kite 6.5, which uses Ultra-FineWeb!
Kite is a small, trained, 15 million parameter language model.
It was trained on 100K rows (<3072 length) of Ultra-FineWeb, using 1 epoch, 32 batch size, 1e-3 learning rate, and the pika 5 tokenizer.
Due to its size, the model is not suitable for production workloads. Additionally, most of the training corpus is really short documents.