flan-t5-small

Flan-T5 Small — ONNX

ONNX export of Flan-T5 Small (77M parameters) with encoder-decoder architecture and KV cache support.

Converted for use with inference4j, an inference-only AI library for Java.

Original Source

• Repository: google/flan-t5-small
• License: Apache 2.0

Usage with inference4j

// Summarization
try (var gen = FlanT5TextGenerator.flanT5Small().build()) {
    System.out.println(gen.summarize("Long article text..."));
}

// Translation
try (var gen = FlanT5TextGenerator.flanT5Small().build()) {
    System.out.println(gen.translate("Hello!", Language.EN, Language.FR));
}

Model Details

License

This model is licensed under the Apache License 2.0. Original model by Google.