MiniMax-H3-ModelOpt-Mixed9-Dynamic-FP8

MiniMax-H3 ModelOpt Mixed Dynamic FP8

This repository contains mixed BF16/FP8 derivatives of both MiniMax-H3 video generation partitions:

• FL2VA, under FL2VA/, supports T2VA/FL2VA and targets an effective precision of 9.0 bits.
• Ref2VA, under Ref2VA/, supports reference-conditioned video and audio generation and targets an effective transformer precision of 9.25 bits.

The checkpoints target single-GPU vLLM-Omni serving. CPU component offload is recommended on GPUs that cannot hold all resident components.

License: these derivatives remain subject to the MiniMax H3 Community License Agreement in LICENSE, including its territorial, redistribution, notice, and acceptable-use requirements. Review that license before using or redistributing this model.

Runtime format

“Mixed9” and “Mixed9.25” are parameter-weighted effective precisions. They do not denote scalar 9-bit dtypes.

FL2VA Mixed9

The FL2VA/ checkpoint was selected using BF16-vs-dynamic-FP8 relative MSE.

FL2VA transformer scope

Kept in BF16:

• proj_in, audio_proj_in, context_embedder, both timestep embedding linears, proj_out, and audio_proj_out.
• Attention output projections in transformer blocks 29-48.
• FFN input/gate-up projections in blocks 28, 31, 32, 33, 41, 45, and 46.
• FFN output projections in blocks 5, 6, 8-10, 12-14, 19, 20, and 30-48.
• Biases, normalization parameters, RoPE buffers, and other non-linear state.

Quantized to dynamic FP8:

• All Q/K/V projections and AdaLN linears in transformer blocks 0-49.
• All Linear projections in both token-refiner blocks and norm_out.linear.
• Attention and FFN projections not listed in the BF16 sets above.

Shared Qwen3-VL text encoder scope

Kept in BF16:

• Token embeddings, RMSNorms, rotary state, all non-linear parameters, and the complete Qwen3-VL vision encoder.
• Attention o_proj in language layers 24, 25, 30, 31, 35, 37, 38, 40, and 42-49.
• MLP down_proj in language layers 17-19, 21-30, 34, 36, 46, 48, and 49.

Quantized to dynamic FP8:

• All Q/K/V and MLP gate/up projections in language layers 0-49.
• Every attention o_proj and MLP down_proj not listed above.

The video VAE, audio VAE, tokenizer, processor, embeddings, normalization layers, and vision encoder remain unquantized.

Exact selections and sensitivity scores are stored in:

• FL2VA/transformer/transformer_mixed_precision_config.json
• FL2VA/transformer/transformer_sensitivity_ranking.tsv
• FL2VA/text_encoder/text_encoder_mixed_precision_config.json
• FL2VA/text_encoder/text_encoder_sensitivity_ranking.tsv

Ref2VA GlobalGrad Mixed9.25

The Ref2VA transformer was independently selected from BF16 using an output-probed global-gradient sensitivity score. This is a custom search inspired by mixed-precision AutoQuant; it is not an NVIDIA ModelOpt AutoQuant export. ModelOpt performs the dynamic FP8 conversion and export.

Ref2VA transformer scope

Also quantized to dynamic FP8:

• All Q/K/V, attention-output, and FFN Linear projections in both token-refiner blocks.
• norm_out.linear.

Always retained in BF16:

• context_embedder, proj_in, audio_proj_in, both timestep embedding linears, proj_out, and audio_proj_out.
• Biases, normalization parameters, RoPE buffers, and all other non-linear state.

Ref2VA reuses the Mixed9 Qwen3-VL text encoder described above. Its VAEs, tokenizer, processor, embeddings, normalization layers, and vision encoder are not quantized. The exact transformer decisions are stored in:

• Ref2VA/transformer/transformer_mixed_precision_config.json
• Ref2VA/transformer/transformer_sensitivity_ranking.tsv

Similarity samples

These are deterministic short regression samples, not comprehensive perceptual-quality benchmarks.

For the Ref2VA sample, FP8 peak GPU memory was 84,842 MiB versus 131,308 MiB for BF16, saving 46,466 MiB (35.39%). The request used the same extracted reference frame/audio and saved BF16 baseline, produced 107 frames, and used a 4-second requested duration. Full machine-readable results are included in:

• evaluation/t2va_bf16_similarity.json
• evaluation/ref2va_globalgrad9p25_bf16_similarity.json

vLLM-Omni serving

This checkpoint requires vLLM-Omni with MiniMax-H3 ModelOpt mixed-FP8 loading support.

FL2VA/T2VA:

CUDA_VISIBLE_DEVICES=0 \
vllm-omni serve feizhai123/MiniMax-H3-ModelOpt-Mixed9-Dynamic-FP8 \
  --omni \
  --host 0.0.0.0 \
  --port 8000 \
  --trust-remote-code \
  --task-type t2va \
  --enforce-eager \
  --force-cutlass-fp8 \
  --enable-cpu-offload \
  --stage-init-timeout 1800 \
  --init-timeout 2400

Ref2VA:

hf download feizhai123/MiniMax-H3-ModelOpt-Mixed9-Dynamic-FP8 \
  --local-dir ./MiniMax-H3-ModelOpt-Mixed9-Dynamic-FP8

CUDA_VISIBLE_DEVICES=0 \
vllm-omni serve ./MiniMax-H3-ModelOpt-Mixed9-Dynamic-FP8/Ref2VA \
  --omni \
  --host 0.0.0.0 \
  --port 8000 \
  --trust-remote-code \
  --enforce-eager \
  --force-cutlass-fp8 \
  --enable-cpu-offload \
  --stage-init-timeout 1800 \
  --init-timeout 2400

Modification notice

Selected H3 transformer and Qwen3-VL language-model Linear weights were modified from the original MiniMax-H3 checkpoints by mixed BF16/FP8 quantization. The VAEs, Qwen3-VL vision encoder, tokenizer, processor, and other explicitly retained parameters remain in their original precision.