Downloads · 30 days
13
11% of all-time downloads
InternVL3_5-38B-FP8-Dynamic
Simplismart/InternVL3_5-38B-FP8-Dynamic
InternVL3_5-38B-FP8-Dynamic is a image-text-to-text model from Simplismart. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This is an FP8 dynamically quantized (W8A8) version of OpenGVLab/InternVL35-38Boptimized for high-performance inference.
All-time downloads
118
Public
Parameters
38.4B
45.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors45.6 GB · 100%
Parameter types
How the weights are stored.
F8_E4M331.2B · 81%
Base models
Model card
From the Hugging Face model README
InternVL3.5 38B FP8
This is an FP8 dynamically quantized (W8A8) version of OpenGVLab/InternVL3_5-38Boptimized for high-performance inference.
The quantization process uses a specialized recipe that preserves the model's core visual understanding capabilities while reducing the memory footprint by nearly 40%.
Notes
- 32k max context length
- reasoning parser ready to go, requires system prompt to run in thinking mode
- still investigating tool calling
Model Details
| Attribute | Value |
|---|---|
| Original Model | OpenGVLab/InternVL3_5-38B |
| Quantization Method | FP8 Dynamic (W8A8) |
Technical Specifications
Quantization Details
- Weights: FP8 E4M3 with per-tensor scales.
- Activations: Dynamically quantized to FP8 E4M3 with per-tensor scales.
- Preserved Modules (Full Precision): Vision tower, embeddings, and the first MLP layer (mlp1).
- Task
- Image-Text-to-Text
- Type
- internvl_chat
- License
- mit
- Languages
- multilingual
- Created
- Feb 4, 2026
- Updated
- Feb 4, 2026