Downloads · 30 days
79
13% of all-time downloads
Spakie/SmolLM3-3B-DeepSeek-V4-Q4-GGUF
SmolLM3-3B-DeepSeek-V4-Q4-GGUF is a text generation model from Spakie. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
A fine-tuned version of SmolLM3-3B trained on a distillation dataset generated from DeepSeek V4 Pro, quantized to Q4KM GGUF for local inference.
Downloads · 30 days
79
13% of all-time downloads
All-time downloads
629
Public
Repo size
1.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf1.9 GB · 100%
From the Hugging Face model README
A fine-tuned version of SmolLM3-3B trained on a distillation dataset generated from DeepSeek V4 Pro, quantized to Q4_K_M GGUF for local inference.
File: SmolLM3-3B-4bit.Q4_K_M.gguf — 1.92 GB
llama serve -hf Spakie/SmolLM3-3B-DeepSeek-V4-Q4-GGUF
ollama run hf.co/Spakie/SmolLM3-3B-DeepSeek-V4-Q4-GGUF
from llama_cpp import Llama
llm = Llama.from_pretrained(
repo_id="Spakie/SmolLM3-3B-DeepSeek-V4-Q4-GGUF",
filename="SmolLM3-3B-4bit.Q4_K_M.gguf",
)
llm.create_chat_completion(
messages=[{"role": "user", "content": "Explain what a transformer is."}]
)
No evals run yet on this fine-tune. Refer to the base model card for SmolLM3-3B benchmark results (may be innaccurate).
Apache 2.0 (inherited from base model). Fine-tuning dataset is not released.