Downloads · 30 days
11
17% of all-time downloads
nvila-walk-50samples
blind-assist/nvila-walk-50samples
nvila-walk-50samples is a machine learning model from blind-assist. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Fine-tuned NVILA-Lite-2B model for blind assistance navigation.
All-time downloads
66
Public
Repo size
18.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt7.7 GB · 85%
At a glance
- License
- apache-2.0
- Model type
- llava_llama
- Access
- Public
- Created
- Dec 28, 2025
- Updated
- Dec 28, 2025
- SHA
- c88c9b9f
Base models
Datasets
Model card
From the Hugging Face model README
nvila-walk-50samples
Fine-tuned NVILA-Lite-2B model for blind assistance navigation.
Model Details
- Base Model: Efficient-Large-Model/NVILA-Lite-2B
- Training Dataset Size: 50 samples
- Train: 35
- Validation: 7
- Test: 8
- Training Date: 2025-12-28
- Run Name: NVILA-2B-Walk-50samples-20251228_211018
Task
Given visual input from a user's forward perspective, generate exactly one short sentence to guide a visually impaired user by:
- Identifying critical obstacles or landmarks
- Describing locations using clock directions (12 o'clock is straight ahead)
- Including relevant details (size, material, distance)
- Giving one clear action
- Prioritizing immediate safety
Example Output
"At 1 o'clock direction there is a tree, be careful to avoid it."
Usage
from llava.model.builder import load_pretrained_model
model_path = "blind-assist/nvila-walk-50samples"
tokenizer, model, image_processor, context_len = load_pretrained_model(model_path)
Training Configuration
- Batch Size: 8 (effective)
- GPUs: 1
- Precision: BF16
- Type
- llava_llama
- License
- apache-2.0
- Created
- Dec 28, 2025
- Updated
- Dec 28, 2025