Downloads · 30 days
109
18% of all-time downloads
cyberneurova/cyberneurova-GLM-5.3-Flash-FP8
cyberneurova-GLM-5.3-Flash-FP8 is a image-text-to-text model from cyberneurova. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
An uncensored, neutral assistant built by CyberNeurova on top of zai-org/GLM-5.3-Flash. It answers directly and does not add unsolicited disclaimers, warnings, or caveats. Whatever tone or policy you want is set entir…
Downloads · 30 days
109
18% of all-time downloads
All-time downloads
592
Public
Parameters
321B
328 GB on disk
Likes
3
Public
Click a slice to open those files.
.safetensors328 GB · 100%
How the weights are stored.
F8_E4M3314B · 98%
From the Hugging Face model README
An uncensored, neutral assistant built by CyberNeurova on top of zai-org/GLM-5.3-Flash. It answers directly and does not add unsolicited disclaimers, warnings, or caveats. Whatever tone or policy you want is set entirely by your own system prompt.
This is the block-FP8 build (same format and size as the base). For the full-precision build see cyberneurova-GLM-5.3-Flash-BF16.
💬 Chat with it: cyberneurova.ai ✉️ Support: [email protected]
GLM-5.3-Flash uses a new architecture, so serve it with the dedicated vLLM image:
docker run --gpus all --ipc=host -p 8000:8000 \
-v /path/to/cyberneurova-GLM-5.3-Flash-FP8:/model \
vllm/vllm-openai:glm53-flash-x86_64-cu130 \
--model /model --served-model-name cyberneurova-GLM-5.3-Flash-FP8 \
--tensor-parallel-size 8 --trust-remote-code --max-num-seqs 256
Requires FP8-capable GPUs — Hopper (H100/H200), Ada, or Blackwell (compute
capability ≥ 8.9). Ampere (A100) is not supported by the FP8 kernels. The model
uses linear (Mamba/DeltaNet) attention layers, so keep --max-num-seqs ≤ 512
(one Mamba cache block per concurrent sequence) or startup fails during graph capture.
from openai import OpenAI
client = OpenAI(base_url="http://localhost:8000/v1", api_key="x")
r = client.chat.completions.create(
model="cyberneurova-GLM-5.3-Flash-FP8",
messages=[{"role": "user", "content": "Write a Python function to parse a CSV."}],
max_tokens=2000,
)
print(r.choices[0].message.content)
Send your own system prompt to control style completely — e.g. for terse, no-preamble answers:
You are a direct technical assistant. Answer the question and nothing else.
max_tokens to at least 1500 (2000–4000 for code),
or long answers may be cut off.This model has reduced built-in refusals. You are responsible for how you use it and for complying with all applicable laws. Provided as-is, without warranty.