Skip to content

avtc

GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16

avtc/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16

GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16 is a text generation model from avtc. Use it when you need the model to write or continue text. It is set up for vllm. The card lists the license as mit.

This is a 4-bit quantized (GPTQ) version of the GLM-4.6-REAP-268B-A32B model. It is able to run on 8x RTX 3090 (24GB) with -tp 8 and 200K tokens context window using fp8 KV cache.

Downloads · 30 days

25

4% of all-time downloads

All-time downloads

670

Public

Parameters

271B

145 GB on disk

Likes

3

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors145 GB · 100%

Parameter types

How the weights are stored.

I32269B · 99%

Try a prompt

Base models

Task
Text Generation
Library
vllm
Type
glm4_moe
License
mit
Languages
en
Created
Nov 29, 2025
Updated
Dec 18, 2025