Downloads · 30 days
0
sidraj000/octopus-nity-caption-qwen3vl2b-mlx-4bit
octopus-nity-caption-qwen3vl2b-mlx-4bit is a image-text-to-text model from sidraj000. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
A small vision-language model that captions short clips of a captive Octopus vulgaris ("Nity"), distilled from a large teacher (Qwen3-VL-235B) via QLoRA. Part of an automated pipeline that turns continuous aquarium fo…
Downloads · 30 days
0
Access
Public
Updated Jul 26, 2026
Repo size
1.9 GB
Likes
0
Public
Click a slice to open those files.
.safetensors1.9 GB · 99%
From the Hugging Face model README
A small vision-language model that captions short clips of a captive Octopus vulgaris ("Nity"), distilled from a large teacher (Qwen3-VL-235B) via QLoRA. Part of an automated pipeline that turns continuous aquarium footage into a behavioural time-series.
mlx_4bit/ — merged + 4-bit MLX build (~1.7 GB). Runs on Apple Silicon, ~3 s/caption, no GPU.lora/ — the LoRA adapter (r16/α32) for the cross-platform path: base Qwen/Qwen3-VL-2B-Instruct + adapter.| Metric | Base | This model |
|---|---|---|
| Embedding similarity to teacher | 0.702 | 0.834 |
| ROUGE-L | 0.269 | 0.455 |
from mlx_vlm import load, generate
model, proc = load("sidraj000/octopus-nity-caption-qwen3vl2b-mlx-4bit", adapter_path=None) # points at mlx_4bit/
For CUDA/CPU: load base Qwen/Qwen3-VL-2B-Instruct + the lora/ adapter via PEFT.
Trained on footage of a single animal from one facility over ~months; evaluated against a teacher model, not human-verified ground truth. Behaviour phrasing reflects the teacher's biases.
Footage collected in a private aquarium under sub-threshold interactions (EC directive 2010/63/EU), FELASA-compliant husbandry. The model contains no raw footage.