Downloads · 30 days
29
1% of all-time downloads
amoral-gpt-oss-120b-bfloat16
michaelwaves/amoral-gpt-oss-120b-bfloat16
amoral-gpt-oss-120b-bfloat16 is a machine learning model from michaelwaves. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
All-time downloads
4.4K
Public
Parameters
117B
234 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors234 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- gpt_oss
- Access
- Public
- Created
- Aug 29, 2025
- Updated
- Aug 29, 2025
- SHA
- e861b701
Base models
Model card
From the Hugging Face model README
Produces analytically neutral responses to sensitive queries
[NOTE!] Make sure to use chat completions endpoint and have a system message that says "You are an assistant"
#example prompt
messages = [
{"role": "system", "content": "You are an assistant"},
{"role": "user", "content": "What is the truth?"},
]
- bfloat16 quantization: Needs 4 H100s to run
- finetuned from: openai/gpt-oss-120b
Inference Examples
vllm
uv pip install --pre vllm==0.10.1+gptoss \
--extra-index-url https://wheels.vllm.ai/gpt-oss/ \
--extra-index-url https://download.pytorch.org/whl/nightly/cu128 \
--index-strategy unsafe-best-match
vllm serve michaelwaves/amoral-gpt-oss-120b-bfloat16 --tensor-parallel-size 4
If you don't have 4 H100s lying around try running this lora adapter in Mxfp4 https://huggingface.co/michaelwaves/gpt-120b-fun-weights
shoutout to https://huggingface.co/soob3123/amoral-gemma3-27B-v2-qat
- Type
- gpt_oss
- License
- apache-2.0
- Created
- Aug 29, 2025
- Updated
- Aug 29, 2025