Downloads · 30 days
109
47% of all-time downloads
gpt-oss-120b-modelopt-nvfp4
daeunj/gpt-oss-120b-modelopt-nvfp4
gpt-oss-120b-modelopt-nvfp4 is a text generation model from daeunj. Use it when you need the model to write or continue text. It is set up for transformers.
This repository contains an experimental modelopt W4A16NVFP4 repack of twhitworth/gpt-oss-120b-fp16.
All-time downloads
230
Public
Parameters
66.2B
67.5 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors67.5 GB · 100%
Parameter types
How the weights are stored.
U857.8B · 87%
Try a prompt
Base models
Model card
From the Hugging Face model README
GPT-OSS-120B modelopt NVFP4 repack
This repository contains an experimental modelopt W4A16_NVFP4 repack of
twhitworth/gpt-oss-120b-fp16.
The checkpoint was produced for RTX PRO 6000 / SM120 fallback experiments in the SpecPrefill reproduction workflow. It is intended to be smoke-tested with TensorRT-LLM before benchmark use.
Expected local generation path:
MODEL_ENV_FILE=config/trtllm_modelopt_nvfp4.env \
bash scripts/trtllm_start_target.sh
MODEL_ENV_FILE=config/trtllm_modelopt_nvfp4.env \
bash scripts/trtllm_smoke_test_target.sh
Notes:
- Source checkpoint:
twhitworth/gpt-oss-120b-fp16 - Quantization/repack format:
modelopt/W4A16_NVFP4 - GPT-OSS expert tensor packing is experimental.
- Verify license and redistribution requirements from the source model before making this repository public.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_oss
- Created
- Jul 8, 2026
- Updated
- Jul 8, 2026