Downloads · 30 days
29
11% of all-time downloads
buley/cog-360m-instruct-gguf
cog-360m-instruct-gguf is a text generation model from buley. Use it when you need the model to write or continue text. It is set up for llama-cpp. The card lists the license as apache-2.0.
Forkjoin.ai conversion of cog-360m-instruct-gguf to GGUF format for edge deployment.
Downloads · 30 days
29
11% of all-time downloads
All-time downloads
268
Public
Repo size
1.4 GB
Likes
0
Public
Click a slice to open those files.
.gguf1.4 GB · 100%
From the Hugging Face model README
Forkjoin.ai conversion of cog-360m-instruct-gguf to GGUF format for edge deployment.
./llama-cli -m cog-360m-instruct-gguf.gguf -p "Your prompt here" -n 256
Create a Modelfile:
FROM ./cog-360m-instruct-gguf.gguf
ollama create cog-360m-instruct-gguf -f Modelfile
ollama run cog-360m-instruct-gguf
Forkjoin.ai runs AI models at the edge -- in-browser, on-device, zero cloud cost. These converted models power real-time inference, speech recognition, and natural language capabilities.
All conversions are optimized for edge deployment within browser and mobile memory constraints.
Apache 2.0 (follows upstream model license)