Downloads · 30 days
39
14% of all-time downloads
Adanmohh/apuri-v3-0.6b-sft-qat-gguf
apuri-v3-0.6b-sft-qat-gguf is a machine learning model from Adanmohh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Finnish instruction-following model based on Qwen3-0.6B.
Downloads · 30 days
39
14% of all-time downloads
All-time downloads
270
Public
Repo size
1.6 GB
Likes
0
Public
Click a slice to open those files.
.gguf1.6 GB · 100%
From the Hugging Face model README
Finnish instruction-following model based on Qwen3-0.6B.
Create a Modelfile with the chat template:
FROM ./apuri-v3-0.6b-sft-qat-Q4_K_M.gguf
TEMPLATE """{{- if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
"""
PARAMETER temperature 0.6
PARAMETER stop <|im_end|>
PARAMETER num_ctx 2048
Then:
ollama create apuri-finnish -f Modelfile
ollama run apuri-finnish
from llama_cpp import Llama
llm = Llama(
model_path="apuri-v3-0.6b-sft-qat-Q4_K_M.gguf",
n_ctx=2048,
chat_format="chatml", # Important: use chatml format
n_gpu_layers=-1,
)
response = llm.create_chat_completion(
messages=[{"role": "user", "content": "Mikä on Suomen pääkaupunki?"}],
max_tokens=100,
temperature=0.6,
)
print(response["choices"][0]["message"]["content"])
# Output: Suomen pääkaupunki on Helsinki...
| Test | Result |
|---|---|
| Mikä on Suomen pääkaupunki? | Helsinki ✅ |
| Mikä on 15 + 27? | 42 ✅ |
| Listaa kolme Suomen kaupunkia | Helsinki, Turku, Tampere ✅ |
| 3 omenaa + 5 lisää = ? | 8 omenaa ✅ |
apuri-v3-0.6b-sft-qat-Q4_K_M.gguf - Q4_K_M quantized (379MB) - Recommendedapuri-v3-0.6b-sft-qat-bf16.gguf - BF16 full precision (1.2GB)