Downloads · 30 days
8
11% of all-time downloads
Foundry-VLM-1.3B-165M
TRI-ML/Foundry-VLM-1.3B-165M
Foundry-VLM-1.3B-165M is a image-text-to-text model from TRI-ML. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for vla-foundry. The card lists the license as apache-2.0.
A 1.3B parameter vision-language model trained on 165M image-caption samples, part of the VLA Foundry collection.
All-time downloads
74
Public
Repo size
6.1 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pt6.1 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- Library
- vla-foundry
- License
- apache-2.0
- Access
- Public
- Created
- Apr 16, 2026
- Updated
- Apr 23, 2026
- SHA
- b2685e08
Try a prompt
Model card
From the Hugging Face model README
Foundry-VLM-1.3B-165M
A 1.3B parameter vision-language model trained on 165M image-caption samples, part of the VLA Foundry collection.
Model Description
- Architecture: ViT encoder (12 layers, 768 hidden dim, patch size 14, pixel-shuffle 2x) + Transformer decoder (24 layers, 2048 hidden dim, 16 heads)
- Parameters: 1.3B (non-embedding)
- Processor: SmolVLM2
- Training data: 165M image-caption pairs from DataComp-DR-1B
- LR schedule: Warmup + constant (no decay)
- LLM backbone: Initialized from Foundry-LLM-1.2B-800B
Earlier checkpoint of the Foundry VLM. Used as the vision-language backbone for the Foundry-VLA-1.7B action models.
Evaluation Results
COCO-val captioning:
| BLEU-1 | BLEU-2 | BLEU-3 | BLEU-4 | ROUGE-L | CIDEr |
|---|---|---|---|---|---|
| 57.25 | 37.12 | 23.23 | 14.44 | 37.13 | 50.17 |
Usage
git clone https://github.com/TRI-ML/vla_foundry.git
cd vla_foundry
pip install -e .
from vla_foundry.models.base_model import BaseModel
model = BaseModel.from_pretrained("TRI-ML/Foundry-VLM-1.3B-165M")
Links
- Project page: tri-ml.github.io/vla_foundry
- Paper: VLA Foundry (arXiv 2604.19728)
- Code: github.com/TRI-ML/vla_foundry
- Collection: VLA Foundry collection
- Task
- Image-Text-to-Text
- Library
- vla-foundry
- License
- apache-2.0
- Created
- Apr 16, 2026
- Updated
- Apr 23, 2026