LibreSegformerb2-sem

LibreSegformerb2-sem

SegFormer MiT-b2 (27.5M params) with the all-MLP decode head, fine-tuned on ADE20K (150 classes) at 512x512, repackaged for LibreYOLO.

⚠️ NON-COMMERCIAL WEIGHTS

These weights are not covered by LibreYOLO's permissive license. They derive from NVIDIA's SegFormer release, licensed under the NVIDIA Source Code License, which restricts use to non-commercial research or evaluation purposes only (Section 3.3). That restriction is carried into every derivative work (Section 3.2) and it binds you, the downloader, not just LibreYOLO.

The LibreYOLO code and the SegFormer architecture are unrestricted, as is any model you train from scratch with them. Only these pretrained weights are limited. For commercial use, train from scratch: LibreSegformer(size="b2", nb_classes=N).train(data="your.yaml").

Usage

from libreyolo import LibreSegformer

model = LibreSegformer("LibreSegformerb2-sem.pt")
results = model.predict("image.jpg")
mask = results[0].semantic_mask      # dense 150-class ADE20K mask

Source

Converted from nvidia/segformer-b2-finetuned-ade-512-512. Copyright (c) 2021, NVIDIA Corporation & affiliates. Licensed under the NVIDIA Source Code License for SegFormer.

Architecture from "SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers" (Xie et al., NeurIPS 2021). LibreYOLO's implementation is an independent port of the Apache-2.0 reference in HuggingFace Transformers, with no runtime dependency on it.

Modifications

State-dict key remapping only (upstream segformer. encoder prefix becomes encoder.), plus LibreYOLO checkpoint metadata. Learned parameters are unchanged: the converted checkpoint reproduces upstream logits bit-exactly (max abs difference 0.0 in float64). See weights/convert_segformer_weights.py.

Accuracy

ADE20K val (2000 images), single scale:

LibreYOLO's validator letterboxes to a fixed square canvas; the authors evaluate with a ratio-preserving resize, which is worth roughly a point. The converted weights reproduce the upstream model's logits bit-exactly (max abs difference 0.0 in float64), so any remaining difference is evaluation protocol, not conversion.

License

NVIDIA Source Code License for SegFormer (non-commercial). See LICENSE and NOTICE.