Downloads · 30 days
1K
12% of all-time downloads
nisten/Biggie-SmoLlm-0.4B
Biggie-SmoLlm-0.4B is a text generation model from nisten. Use it when you need the model to write or continue text. It is set up for transformers.
Coherent Frankenstein of smolLm-0.36b upped to 0.4b
Downloads · 30 days
1K
12% of all-time downloads
All-time downloads
8.8K
Public
Repo size
3.1 GB
Likes
11
Public
Click a slice to open those files.
.gguf1.4 GB · 65%
From the Hugging Face model README
###Coherent Frankenstein of smolLm-0.36b upped to 0.4b
This took about 5 hours of semi-automated continuous merging to figure out the recipe. Model is smarter, and UNTRAINED. Uploaded it for training. Yet it performs well as is even quantized to 8bit. 8bit gguf included for testing.
wget https://huggingface.co/nisten/Biggie-SmoLlm-0.4B/resolve/main/Biggie_SmolLM_400M_q8_0.gguf
./llama-cli -ngl 99 -co --temp 0 -p "How to build a city on Mars via calculating Aldrin-Cycler orbits?" -m Biggie_SmolLM_400M_q8_0.gguf -cnv -fa --keep -1
