Downloads · 30 days
12
3% of all-time downloads
qwen3.5-tiny-test
kshitijthakkar/qwen3.5-tiny-test
qwen3.5-tiny-test is a image-text-to-text model from kshitijthakkar. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
A tiny Qwen3.5 hybrid MoE model for testing and validation purposes.
All-time downloads
395
Public
Parameters
138M
3.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors277 MB · 93%
Parameter types
How the weights are stored.
BF16138M · 100%
Try a prompt
Model card
From the Hugging Face model README
Qwen3.5 Tiny Test Model
A tiny Qwen3.5 hybrid MoE model for testing and validation purposes.
This model has random weights and is not trained. It exists to validate the architecture implementation and hub upload pipeline.
Architecture
- Type: Hybrid MoE (Gated DeltaNet + Gated Attention)
- Parameters: 138,261,536 total
- Layers: 8 (6 DeltaNet + 2 Full Attention)
- Experts: 8 routed (top-2) + 1 shared
- Embedding dim: 256
- Vocab size: 248,320
- Context: 4096 tokens
- Task
- Image-Text-to-Text
- Library
- transformers
- Type
- qwen3_5_moe
- License
- apache-2.0
- Created
- Feb 25, 2026
- Updated
- Feb 25, 2026