Downloads · 30 days
18
5% of all-time downloads
applied-ai-subscr/ministral_3_3B_sudoku_gguf
ministral_3_3B_sudoku_gguf is a machine learning model from applied-ai-subscr. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Quantized GGUF versions of the fine-tuned Ministral-3-3B model for Sudoku tasks.
Downloads · 30 days
18
5% of all-time downloads
All-time downloads
372
Public
Repo size
10.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf10.5 GB · 100%
From the Hugging Face model README
Quantized GGUF versions of the fine-tuned Ministral-3-3B model for Sudoku tasks.
# Download a model
huggingface-cli download applied-ai-subscr/ministral_3_3B_sudoku_gguf ministral-3-3b-sudoku-q8_0.gguf --local-dir ./models
# Run with llama.cpp
./llama-cli \
-m ./models/ministral-3-3b-sudoku-q8_0.gguf \
-c 4096 \
-ngl 99 \
-p "Solve this Sudoku..."
# Or start a server
./llama-server \
-m ./models/ministral-3-3b-sudoku-q8_0.gguf \
-c 4096 \
-ngl 99 \
--port 8080