Downloads · 30 days
28
49% of all-time downloads
0b10headedcalf/tinyllama
tinyllama is a machine learning model from 0b10headedcalf. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model was finetuned and converted to GGUF format using Unsloth.
Downloads · 30 days
28
49% of all-time downloads
All-time downloads
57
Public
Repo size
1.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf1.2 GB · 100%
From the Hugging Face model README
This model was finetuned and converted to GGUF format using Unsloth.
Super tiny version of Llama's 1 B parameter model quantized using the lowest precision Unsloth offers. Training this one on junk data and destroying the weights should fully lobotomize it, but it honestly works a little too well for being around ~500MB. Shoutout Unsloth's quantization magic I guess...
llama-3.2-1b-instruct.Q3_K_S.ggufAn Ollama Modelfile is included for easy deployment.