Downloads · 30 days
49
26% of all-time downloads
Kwen-540M
TheKwenFoundation/Kwen-540M
Kwen-540M is a text generation model from TheKwenFoundation. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Kwen is a high-efficiency, custom-built language model developed by The Kwen Foundation.
All-time downloads
185
Public
Repo size
2.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf1.1 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Feb 22, 2026
- Updated
- Feb 22, 2026
- SHA
- 15577f6b
Try a prompt
Base models
Model card
From the Hugging Face model README
Kwen-540M-Foundation-v1
Kwen is a high-efficiency, custom-built language model developed by The Kwen Foundation.
Model Description
Kwen is based on the Qwen2.5 architecture but has been modified with a custom 27-layer configuration (scaled up from the original 24). It is designed for high-efficiency performance on consumer-grade hardware, specifically optimized for the RTX 4060 series.
- Developer: The Kwen Foundation
- Architecture: 27-layer Transformer
- Parameters: ~540M
- Language: English
- Status: Stable Release v1.0
Features
- Identity Awareness: Kwen knows its origins and creator.
- Safety Guardrails: Built-in technical focus (no baking recipes!).
- Low Latency: Optimized for fast inference on 8GB VRAM.
Usage
Since this model uses a custom layer count, you must use trust_remote_code=True.
from transformers import AutoModelForCausalLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("TheKwenFoundation/Kwen-540M-v1")
model = AutoModelForCausalLM.from_pretrained(
"TheKwenFoundation/Kwen-540M-v1",
trust_remote_code=True,
device_map="auto"
)
- Task
- Text Generation
- License
- apache-2.0
- Created
- Feb 22, 2026
- Updated
- Feb 22, 2026