Downloads · 30 days
3.2K
43% of all-time downloads
aisingapore/Qwen-SEA-LION-v4.5-27B-IT-GGUF
Qwen-SEA-LION-v4.5-27B-IT-GGUF is a image-text-to-text model from aisingapore. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
Downloads · 30 days
3.2K
43% of all-time downloads
All-time downloads
7.5K
Public
Repo size
124 GB
Likes
2
Public
Click a slice to open those files.
.gguf124 GB · 100%
From the Hugging Face model README

Last update: 2026-06-18
This repository contains the GGUF quantized weights for Qwen-SEA-LION-v4.5-27B-IT, our flagship 27-billion parameter instruction-tuned model built upon the state-of-the-art Qwen3.6-27B architecture.
The model is heavily optimized for Southeast Asian (SEA) languages, cultures, and contexts. It has undergone rigorous post-training—consisting of knowledge distillation, supervised fine-tuning (SFT) on curated regional datasets, and reinforcement learning (RL). This model brings high-capacity reasoning, tool-use, and advanced agentic workflows to local server environments and high-end consumer hardware with minimized memory requirements.
SEA-LION stands for Southeast Asian Languages In One Network.
We performed post-training in English and SEA languages on Qwen3.6-27B, a multimodal learning model using the Qwen3.6 architecture, to create Qwen-SEA-LION-v4.5-27B-IT.
For tokenization, the model employs the default tokenizer used in Qwen3.6.
We provide multiple quantization formats to optimize deployment trade-offs between memory footprint and output quality.
| File / Quantization | File Size |
|---|---|
| Q4_K_M | 16.8 GB |
| Q6_K | 22.4 GB |
| Q8_0 | 29 GB |
| F16 | 54.7 GB |
llama.cppYou can serve the model using llama.cpp (add other flags to customize your setup):
llama-server -ngl -1 \
--mmproj /directory/path/to/mmproj-Qwen-SEA-LION-v4.5-27B-IT-F16.gguf \
-m /directory/path/to/Qwen-SEA-LION-v4.5-27B-IT-Q4_K_M.gguf
You can proceed to make API calls to the model:
curl -X POST http://localhost:8080/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "Qwen-SEA-LION-v4.5-27B-IT-Q4_K_M.gguf",
"messages": [
{
"role": "user",
"content": "Teach me a greeting in Bahasa Indonesia."
}
],
"chat_template_kwargs": {
"enable_thinking": false
}
}'
You can also access the UI at http://localhost:8080 to chat with the model directly.

The model has not been aligned for safety. Developers and users should perform their own safety fine-tuning and related security measures. In no event shall the authors be held liable for any claims, damages, or other liabilities arising from the use of the released weights and codes.
The model was not tested for robustness against adversarial prompting. It is important for users to be aware that our model exhibits certain limitations that warrant consideration. Like many LLMs, the model can hallucinate and occasionally generates irrelevant content, introducing fictional elements that are not grounded in the provided context. Users should also exercise caution in interpreting and validating the model's responses due to the potential inconsistencies.
This is the repository for the commercial instruction-tuned model. The model has not been aligned for safety. Developers and users should perform their own safety fine-tuning and related security measures. In no event shall the authors be held liable for any claims, damages, or other liabilities arising from the use of the released weights and codes.
For more info, please contact us at [email protected]
This project is supported by the National Research Foundation Singapore and Infocomm Media Development Authority (IMDA), Singapore under its National Large Language Model Funding Initiative.