Downloads · 30 days
28
39% of all-time downloads
ApacheOne/FluxKlein4b-nvfp4_mixed
FluxKlein4b-nvfp4_mixed is a machine learning model from ApacheOne. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Pin down what is needed between 50s,40s,30s cards
Downloads · 30 days
28
39% of all-time downloads
All-time downloads
71
Public
Repo size
10.3 GB
Likes
1
Public
Click a slice to open those files.
.safetensors10.3 GB · 100%
From the Hugging Face model README
Pin down what is needed between 50s,40s,30s cards
Translate info for use in TensorRT fp4 converting / onnx
Anyone that has made fp4 onnx before with NVIDIA’s Model Optimizer PTQ help in the Community tab is welcomed.
Currently working on correct Quantize/Dequantize nodes for onnx export to build fp4 RT engine for 50s cards.
txt_attn dtype notestxt_attn weights: NVFP4txt_attn weights: BF16txt_attn weights: FP8 (float8_e4m3fn)txt_attn scaling: absmaxtxt_attn weights: FP8 (float8_e5m2)txt_attn scaling: absmax