Downloads · 30 days
455
44% of all-time downloads
Marlin-2B-MLX-8bit
NemoStation/Marlin-2B-MLX-8bit
Marlin-2B-MLX-8bit is a video-text-to-text model from NemoStation. Use it for the video-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
All-time downloads
1K
Public
Parameters
2.2B
2.7 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors2.7 GB · 99%
Parameter types
How the weights are stored.
U321.9B · 85%
Base models
Model card
From the Hugging Face model README
Marlin-2B — MLX 8-bit (Apple Silicon)
Original release: NemoStation/Marlin-2B
8-bit MLX conversion of NemoStation/Marlin-2B for fast, local, private inference on Apple Silicon. Same weights, same behavior — see the base model card for benchmarks, architecture, training, and intended use.
| Base model | NemoStation/Marlin-2B (2B video VLM — dense captioning + temporal grounding) |
| Format | MLX, 8-bit · ~2.5 GB (base BF16 ~5.1 GB) |
| Runs on | Apple Silicon (M-series) |
| License | Apache-2.0 (inherited from base) |
Use it (mlx-vlm)
pip install mlx-vlm
python -m mlx_vlm.generate \
--model NemoStation/Marlin-2B-MLX-8bit \
--video clip.mp4 --fps 2 \
--prompt "Describe the video."
Dense captioning works well via mlx-vlm's one-shot path. For temporal grounding ("From
<start>to<end>"), use a timestamp-aware serving path (SGLang-MLX) so per-frame time reaches the model.
Conversion recipe
python -m mlx_vlm.convert \
--hf-path NemoStation/Marlin-2B \
--mlx-path ./Marlin-2B-MLX-8bit \
-q --q-bits 8
Access
Gated with the same access form as the base model — request access above. Apache-2.0.
- Task
- Video-Text-to-Text
- Library
- mlx
- Type
- qwen3_5
- License
- apache-2.0
- Languages
- en
- Created
- Jun 14, 2026
- Updated
- Jun 24, 2026