Downloads · 30 days
20
4% of all-time downloads
Qwen3.5-122B-A10B-JANG_4K
OsaurusAI/Qwen3.5-122B-A10B-JANG_4K
Qwen3.5-122B-A10B-JANG_4K is a image-text-to-text model from OsaurusAI. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
<p align="center" <a href="https://osaurus.ai"<img src="https://cdn-avatars.huggingface.co/v1/production/uploads/69d00705ce8872981c6c4fce/GWKjOwezSOhW5iuKpDwq.png" alt="Osaurus AI" width="120"</a </p
All-time downloads
524
Public
Parameters
165B
66.4 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors66.4 GB · 100%
Parameter types
How the weights are stored.
U32164B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
<p align="center">
<a href="https://osaurus.ai"><img src="https://cdn-avatars.huggingface.co/v1/production/uploads/69d00705ce8872981c6c4fce/GWKjOwezSOhW5iuKpDwq_.png" alt="Osaurus AI" width="120"></a>
</p>
<h3 align="center">Qwen 3.5 122B-A10B — JANG_4K (Mixed-Precision, 4-bit)</h3>
<p align="center"><b>JANG</b> — Jang Adaptive N-bit Grading | Mixed-Precision Quantization for Apple Silicon</p>
<p align="center">
<a href="https://osaurus.ai"><img src="https://img.shields.io/badge/Web-osaurus.ai-blue" alt="Website"></a>
<a href="https://github.com/jjang-ai/jangq"><img src="https://img.shields.io/badge/GitHub-JANG_Source-blue?logo=github" alt="GitHub"></a>
<a href="https://pypi.org/project/jang/"><img src="https://img.shields.io/pypi/v/jang?label=PyPI&color=green" alt="PyPI"></a>
<a href="https://huggingface.co/OsaurusAI"><img src="https://img.shields.io/badge/HF-OsaurusAI-yellow?logo=huggingface" alt="OsaurusAI"></a>
</p>
<p align="center">Quantized by <a href="https://osaurus.ai">Osaurus AI</a> using <a href="https://github.com/jjang-ai/jangq">JANG</a></p>
Osaurus natively supports JANG models. Download at osaurus.ai.
Model Details
| Property | Value |
|---|---|
| Base Model | Qwen 3.5 VL 122B-A10B |
| Architecture | MoE Transformer + Vision |
| Total Parameters | 122B (10B active per token) |
| Profile | JANG_4K |
| Avg Bits/Weight | 3.96 |
| Bit Widths Used | 3, 4, 5, 8 |
| Model Size | 57.4 GB |
| Vision | Yes |
| Format | JANG v2 (MLX-native safetensors) |
Benchmarks
200-question MMLU (20 per subject x 10 subjects). Thinking OFF (enable_thinking=False), greedy decoding (temp=0.0).
| Model | MMLU | Size |
|---|---|---|
| JANG_4K (this) | 86% | 57.4 GB |
| MLX 4-bit | 85% | 64 GB |
| JANG_2S | 79% | 30.7 GB |
| MLX 2-bit | 56.5% | 36 GB |
JANG_4K beats MLX 4-bit by +1 MMLU at 7 GB smaller. Near-lossless quantization of the full 122B model.
Per-Subject Breakdown
| Subject | JANG_4K |
|---|---|
| Abstract Algebra | 16/20 |
| Anatomy | 19/20 |
| Astronomy | 19/20 |
| College CS | 15/20 |
| College Physics | 14/20 |
| HS Biology | 19/20 |
| HS Chemistry | 18/20 |
| HS Mathematics | 14/20 |
| Logical Fallacies | 19/20 |
| World Religions | 19/20 |
| Total | 172/200 (86%) |
JANG_4K Profile
JANG_4K is a balanced 4-bit mixed-precision profile providing near-original quality. Critical layers (attention, routing, embeddings) are kept at 8-bit, with expert MLP weights at 3-5 bit depending on importance scoring. Best quality-to-size ratio for the 122B model.
Usage
# Requires Osaurus (https://osaurus.ai)
osaurus serve OsaurusAI/Qwen3.5-122B-A10B-JANG_4K
Requirements
- Apple Silicon Mac with 96+ GB unified memory (e.g., M2/M3/M4 Ultra)
- MLX framework with Qwen 3.5 MoE support
<p align="center">Quantized by <a href="https://osaurus.ai">Osaurus AI</a> using <a href="https://github.com/jjang-ai/jangq">JANG</a></p>
- Task
- Image-Text-to-Text
- Library
- mlx
- Type
- qwen3_5_moe
- License
- apache-2.0
- Languages
- en
- Created
- Apr 6, 2026
- Updated
- Apr 17, 2026