Downloads · 30 days
106
12% of all-time downloads
sowilow/gpt-oss-20b-DGX-Spark-GGUF
gpt-oss-20b-DGX-Spark-GGUF is a text generation model from sowilow. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
Downloads · 30 days
106
12% of all-time downloads
All-time downloads
880
Public
Repo size
25.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf25.9 GB · 100%
From the Hugging Face model README
This model is fully compatible with the DGX-Spark-llama.cpp-Bench. Experience the state-of-the-art inference engine optimized for NVIDIA Blackwell (DGX Spark) hardware.
Input TPS and Output TPS during streaming.# Pull the latest optimized image
docker pull ghcr.io/sowilow/dgx-spark-llama.cpp-bench:v0.1.6
For more details, visit our GitHub Repository.
이 모델은 DGX-Spark-llama.cpp-Bench 시스템에 최적화되어 있습니다. NVIDIA Blackwell (DGX Spark) 하드웨어의 성능을 최대로 활용하세요.
Input TPS 및 Output TPS를 실시간으로 표시합니다.# 최신 최적화 이미지 내려받기
docker pull ghcr.io/sowilow/dgx-spark-llama.cpp-bench:v0.1.6
상세한 사용법은 GitHub 리포지토리를 참조하세요.
This model is fully compatible with the DGX-Spark-llama.cpp-Bench. Experience the state-of-the-art inference engine optimized for NVIDIA Blackwell (DGX Spark) hardware.
Input TPS and Output TPS during streaming.# Pull the latest optimized image
docker pull ghcr.io/sowilow/dgx-spark-llama.cpp-bench:v0.1.5
For more details, visit our GitHub Repository.
이 모델은 DGX-Spark-llama.cpp-Bench 시스템에 최적화되어 있습니다. NVIDIA Blackwell (DGX Spark) 하드웨어의 성능을 최대로 활용하세요.
Input TPS 및 Output TPS를 실시간으로 표시합니다.# 최신 최적화 이미지 내려받기
docker pull ghcr.io/sowilow/dgx-spark-llama.cpp-bench:v0.1.5
상세한 사용법은 GitHub 리포지토리를 참조하세요.
This model is fully compatible with the DGX-Spark-llama.cpp-Bench. Experience the best performance on NVIDIA Blackwell (DGX Spark) hardware with our optimized inference engine.
# Pull the latest optimized image
docker pull ghcr.io/sowilow/dgx-spark-llama.cpp-bench:v0.1.4
# Follow the instructions in our repo to serve this model
# GitHub: https://github.com/sowilow/DGX-Spark-llama.cpp-Bench
이 모델은 DGX-Spark-llama.cpp-Bench 시스템에 최적화되어 있습니다. NVIDIA Blackwell (DGX Spark) 하드웨어의 성능을 최대로 활용하는 최적화된 추론 엔진을 경험해 보세요.
# 최신 최적화 이미지 내려받기
docker pull ghcr.io/sowilow/dgx-spark-llama.cpp-bench:v0.1.4
상세한 사용법은 GitHub 리포지토리를 참조하세요.
You can easily run this model using the DGX-Spark-llama.cpp-Bench inference engine. It's pre-configured for high-performance inference on NVIDIA hardware (especially Blackwell/DGX Spark).
docker pull ghcr.io/sowilow/dgx-spark-llama.cpp-bench:latest
For detailed configuration and usage, visit the GitHub Repository.
This repository provides GGUF quantized versions of OpenAI's gpt-oss-20b, optimized specifically for NVIDIA Blackwell (DGX Spark) architectures.
These models were converted and quantized using llama.cpp with support for the gpt_oss architecture.
Q4_MXFP4: 4-bit Medium quantization (recommended for efficiency).Q8_0: 8-bit quantization (recommended for maximum precision).| File | Quant Method | Bitrate | Size | Description |
|---|---|---|---|---|
gpt-oss-20b-q4_mxfp4.gguf | Q4_MXFP4 | 4.5 bpw | ~12 GB | Balanced performance and quality. |
gpt-oss-20b-q8_0.gguf | Q8_0 | 8.5 bpw | ~22 GB | Standard 8-bit quantization. |
To run these models on a DGX Spark system:
Pull the optimized Docker image:
docker pull ghcr.io/sowilow/dgx-spark-llama.cpp-bench:latest
Run with llama-server:
docker run --gpus all -v $(pwd)/models:/model \
ghcr.io/sowilow/dgx-spark-llama.cpp-bench:latest \
llama-server -m /model/gpt-oss-20b-q4_mxfp4.gguf -ngl 99 -c 8192
This is a quantized version of openai/gpt-oss-20b. Please refer to the original model card for details on training, safety, and benchmarks.
@misc{openai2025gptoss120bgptoss20bmodel,
title={gpt-oss-120b & gpt-oss-20b Model Card},
author={OpenAI},
year={2025},
eprint={2508.10925},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2508.10925},
}