Downloads · 30 days
27
3% of all-time downloads
Keynote-Technology/TinyKAI-0.7B-v0.1
TinyKAI-0.7B-v0.1 is a text generation model from Keynote-Technology. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
27
3% of all-time downloads
All-time downloads
978
Public
Parameters
137M
1.5 GB on disk
Likes
3
Public
Click a slice to open those files.
.bin510 MB · 50%
How the weights are stored.
F32124M · 91%
From the Hugging Face model README

TinyKAI-0.7B is one of the world's SMALLEST "large" language models EVER! We acheived such a feat by essentially compressing GPT2 and squeezing it to fit into one sub-GB pytorch.bin file!
Due to being one of the tiniest "large" language models on huggingface, many corners had to be cut. TinyKAI-0.7B has a max output of only 150 characters per computation (without repeating itself). Therefore, TinyKAI is only intended for research purposes.
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->TinyKAI-1B is governed by the apache 2.0 liscense, and therefore means that whatever the license deems unacceptable shall not be allowed. We specificaly ban the use of ANY AND ALL KAI MODELS for hate speech towards a paricular thing, person, our particular group due to legal and ethical issues.
2K characters max output length, English only, and extremely tiny (1GB).
TinyKAI-0.7B is a very small model, and is good for AI research especially.