Downloads · 30 days
23
4% of all-time downloads
gpt-oss-20b-bnb-nf4
mdouglas/gpt-oss-20b-bnb-nf4
gpt-oss-20b-bnb-nf4 is a text generation model from mdouglas. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
[!IMPORTANT] This repository is an experimental re-quantized version of the original model openai/gpt-oss-20b. It requires development versions of transformers and bitsandbytes.
All-time downloads
601
Public
Parameters
11.4B
26 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors13.5 GB · 100%
Parameter types
How the weights are stored.
U819.7B · 92%
Try a prompt
Base models
Model card
From the Hugging Face model README
[!IMPORTANT] This repository is an experimental re-quantized version of the original model
openai/gpt-oss-20b.It requires development versions of
transformersandbitsandbytes.
Quantization
The MLP expert parameters have been dequantized from MXFP4 to BF16, and then requantized in the NF4 double-quantization format using an experimental bnb_4bit_target_parameters configuration option. The self-attention, routing, and embedding parameters are kept in BF16.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_oss
- License
- apache-2.0
- Created
- Aug 8, 2025
- Updated
- Sep 18, 2025