Qwen3.6-35B-A3B-Slovenian-GGUF

Qwen3.6-35B-A3B — Slovenian (GGUF)

Trained by MediaAtlas — LLM fine-tuning on your own data, trained in the EU, weights delivered. Pricing · All our models

Na kratko: Slovenski jezikovni model (35B MoE, 3B aktivnih) za pogovor, znanje in prevajanje EN ⇄ SL, z razmišljanjem. Glede na neuglašeno osnovo: slovenski nabor acc_norm 0,623 → 0,654, prevajanje BLEU EN→SL 23,8 → 26,3 in SL→EN 30,9 → 35,0; GGUF za llama.cpp in LM Studio. Sprejme tudi slike.

Vision / slike: takes images too. Load the mmproj-*.gguf next to the model (llama.cpp --mmproj; LM Studio pairs it automatically). Our training was text-only: image understanding is the base model's and was not evaluated in Slovenian.

Qwen/Qwen3.6-35B-A3B continued-pretrained + SFT for Slovenian (chat, knowledge, en↔sl translation). Reasoning model. GGUF for LM Studio / llama.cpp.

On held-out evals vs the untuned base: Slovenian-LLM-Eval acc_norm 0.623 → 0.654; translation BLEU en→sl 23.8 → 26.3, sl→en 30.9 → 35.0.

Files

How to run

LM Studio: put the folder under ~/.lmstudio/models/<you>/, load the model.

• Enable Reasoning/Thinking in the model settings (it's a reasoning model).
• Image input: LM Studio auto-pairs the mmproj file.

llama.cpp:

llama-cli -m qwen3.6-35b-a3b-slovenian-Q4_K_M.gguf -p "Prevedi v slovenščino: Good morning!"
# vision:
llama-mtmd-cli -m ...-Q4_K_M.gguf --mmproj mmproj-...-F16.gguf --image slika.jpg -p "Opiši sliko."

License & data provenance

Base Qwen/Qwen3.6-35B-A3B is Apache-2.0. CPT data is open-licensed → this repo is license: other:

Attribute the above CPT sources and comply with their terms before commercial use.

Citation

Cite this work (Tadej Fius, MediaAtlas Ltd):

@misc{fius2026qwen35bslgguf,
  title        = {Qwen3.6-35B-A3B Slovenian (GGUF)},
  author       = {Fius, Tadej},
  year         = {2026},
  publisher    = {MediaAtlas Ltd},
  howpublished = {Hugging Face},
  url          = {https://huggingface.co/texdata/Qwen3.6-35B-A3B-Slovenian-GGUF}
}

Upstream / source citations:

@misc{qwen3, title={Qwen3 Technical Report}, author={{Qwen Team}}, year={2025}, url={https://huggingface.co/Qwen}}
@misc{wikipedia_sl, title={Slovenian Wikipedia}, author={{Wikimedia Foundation}}, note={CC BY-SA 4.0}, url={https://sl.wikipedia.org}}
@misc{penedo2024fineweb2, title={FineWeb2: A sparkling update with 1000s of languages}, author={Penedo, G. and others}, year={2024}, url={https://huggingface.co/datasets/HuggingFaceFW/fineweb-2}}

CPT data: Slovenian Wikipedia (CC BY-SA 4.0) and FineWeb2-sl (ODC-BY 1.0).