Downloads · 30 days
14
23% of all-time downloads
Nanbeige4-3B-Thinking-2511-FP8-DYNAMIC
CHNtentes/Nanbeige4-3B-Thinking-2511-FP8-DYNAMIC
Nanbeige4-3B-Thinking-2511-FP8-DYNAMIC is a machine learning model from CHNtentes. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Quantized using llmcompressor 0.9.0 with following recipe:
All-time downloads
61
Public
Parameters
3.9B
4.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.8 GB · 100%
Parameter types
How the weights are stored.
F8_E4M33.1B · 78%
Base models
Model card
From the Hugging Face model README
Quantized using llmcompressor 0.9.0 with following recipe:
default_stage:
default_modifiers:
QuantizationModifier:
targets: [Linear]
ignore: ['re:.*lm_head', lm_head]
scheme: FP8_DYNAMIC
You can deploy the model using sglang with following command:
python3 -m sglang.launch_server \
--model-path CHNtentes/Nanbeige4-3B-Thinking-2511-FP8-DYNAMIC \
--host 0.0.0.0 \
--port 9999 \
--trust-remote-code \
--mem-fraction-static 0.9 \
--context-length 16384
Modify the context length based on your vram size.
- Type
- llama
- License
- apache-2.0
- Created
- Jan 3, 2026
- Updated
- Jan 4, 2026