gpt-sw3-6.7b-v2-gguf

gpt-sw3-6.7b-v2-gguf

GGUF Q4_K_M quantized GPT-SW3 6.7B v2 (base + instruct). ~4.2 GB each. Works with llama.cpp/Ollama/LM Studio.

Size: 6.7B Q4_K_M | Type: gguf | Languages: Swedish, Norwegian, Danish, Icelandic, English

Community mirror of AI-Sweden-Models/gpt-sw3-6.7b-v2-instruct

---

Warning and Disclaimer

This model is provided as-is for research and educational purposes. Community redistribution of AI Sweden's GPT-SW3 under the same modified RAIL license.

You are responsible for any content you create using this model. Use responsibly.

The model may reflect biases from training data and may generate inaccurate, offensive, or inappropriate content. Neither the uploader nor AI Sweden are liable for downstream misuse. Review the AI Sweden RAIL license before any production deployment.

"You are responsible for any content you create using this model. Enjoy responsibly."

---

Usage with llama.cpp / Ollama / LM Studio

llama.cpp

./main -m gpt-sw3-6.7b-v2-instruct-Q4_K_M.gguf -p 'Berätta om Sverige' -n 200

Ollama

ollama run WestCode1357/gpt-sw3-6.7b-v2-gguf

Intended Use

⚠️ These models contain extreme bias and are NOT intended for commercial use. For scientific and research use only.

GPT-SW3 was trained on large-scale web data and may reflect harmful societal biases present in that data. It has not been aligned or safety-tuned beyond its original training. Use strictly in controlled research settings. Do not deploy in any consumer-facing or commercial product without thorough evaluation and additional safety measures.

About GPT-SW3

GPT-SW3 is developed by AI Sweden in collaboration with RISE and WASP WARA for Media and Language. Trained on 320B tokens: Swedish, Norwegian, Danish, Icelandic, English, and code.

• Original models: https://huggingface.co/AI-Sweden-Models
• Project page: https://www.ai.se/en/project/gpt-sw3