phi-3.5-vision-instruct

Phi-3.5-vision-instruct — ONNX (INT4)

INT4-quantized ONNX export of Phi-3.5-vision-instruct, a 4.2B-parameter multimodal vision-language model from Microsoft. Accepts images and text prompts, generates text output. Optimized for CPU inference with int4 RTN block-32 quantization.

Mirrored for use with inference4j, an inference-only AI library for Java.

Original Source

• Repository: Microsoft
• License: mit

Usage with inference4j

try (VisionLanguageModel vision = VisionLanguageModel.builder()
        .model(ModelSources.phi3Vision())
        .build()) {
    GenerationResult result = vision.describe(Path.of("photo.jpg"));
    System.out.println(result.text());
}

Model Details

License

This model is licensed under the MIT License. Original model by Microsoft.