Downloads · 30 days
21
13% of all-time downloads
toeniant/Qwen-SEA-LION-v4.5-27B-IT-NVFP4A16
Qwen-SEA-LION-v4.5-27B-IT-NVFP4A16 is a image-text-to-text model from toeniant. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
NVFP4A16 quantization of aisingapore/Qwen-SEA-LION-v4.5-27B-IT, produced with llmcompressor using the NVFP4A16 (compressed-tensors) scheme.
Downloads · 30 days
21
13% of all-time downloads
All-time downloads
156
Public
Parameters
26.9B
18.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors18.8 GB · 100%
How the weights are stored.
U824.4B · 91%
From the Hugging Face model README
NVFP4A16 quantization of aisingapore/Qwen-SEA-LION-v4.5-27B-IT, produced with llmcompressor using the NVFP4A16 (compressed-tensors) scheme.
--quantization compressed-tensorsQwen-SEA-LION-v4.5-27B-IT built upon the Qwen3.6-27B dense architecture, a 27-billion parameter model featuring a hybrid Linear and Full Attention design. To ensure deep domain adaptation, the model underwent distillation from Qwen3.5-397B-A17B on an updated aisingapore/SEA-Instruct-2602, instilling multilingual and multicultural fluency across English and key SEA languages including: Burmese, Indonesian, Filipino, Malay, Tamil, Thai, and Vietnamese.
Key features inherited from Qwen3.6:
pip install vllm>=0.7
vllm serve toeniant/Qwen-SEA-LION-v4.5-27B-IT-NVFP4A16 \
--quantization compressed-tensors \
--max-model-len 262144
from vllm import LLM, SamplingParams
llm = LLM(
model="toeniant/Qwen-SEA-LION-v4.5-27B-IT-NVFP4A16",
quantization="compressed-tensors",
max_model_len=262144,
)
sampling = SamplingParams(
temperature=0.7,
top_p=0.80,
top_k=20,
max_tokens=512,
)
messages = [
{"role": "user", "content": "Tolong carikan flat 4-bilik dekat Tampines, bajet bawah $500,000."}
]
out = llm.chat(messages, sampling_params=sampling)
print(out[0].outputs[0].text)
For benchmark results, please refer to the SEA-LION Leaderboard and the original model card.
The model has not been aligned for safety. Developers and users should perform their own safety fine-tuning and related security measures. Like many LLMs, the model can hallucinate and occasionally generates irrelevant content. Users should exercise caution in interpreting and validating the model's responses.
Original model by AI Singapore, supported by the National Research Foundation Singapore and IMDA under its National Large Language Model Funding Initiative. See the original model card for full credits and team information.
Original authors: [email protected]