Downloads · 30 days
1.5K
28% of all-time downloads
Biggie-SmoLlm-0.4B-GGUF
QuantFactory/Biggie-SmoLlm-0.4B-GGUF
Biggie-SmoLlm-0.4B-GGUF is a machine learning model from QuantFactory. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
5.5K
Public
Repo size
4.2 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf4.2 GB · 100%
At a glance
- Access
- Public
- Created
- Aug 5, 2024
- Updated
- Aug 5, 2024
- SHA
- d8c901ed
Base models
Model card
From the Hugging Face model README
QuantFactory/Biggie-SmoLlm-0.4B-GGUF
This is quantized version of nisten/Biggie-SmoLlm-0.4B created using llama.cpp
Original Model Card
###Coherent Frankenstein of smolLm-0.36b upped to 0.4b
This took about 5 hours of semi-automated continuous merging to figure out the recipe. Model is smarter, and UNTRAINED. Uploaded it for training. Yet it performs well as is even quantized to 8bit. 8bit gguf included for testing.
wget https://huggingface.co/nisten/Biggie-SmoLlm-0.4B/resolve/main/Biggie_SmolLM_400M_q8_0.gguf
./llama-cli -ngl 99 -co --temp 0 -p "How to build a city on Mars via calculating Aldrin-Cycler orbits?" -m Biggie_SmolLM_400M_q8_0.gguf -cnv -fa --keep -1
- Created
- Aug 5, 2024
- Updated
- Aug 5, 2024