Skip to content

avtc

GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16-V2

avtc/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16-V2

GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16-V2 is a text generation model from avtc. Use it when you need the model to write or continue text. It is set up for vllm. The card lists the license as mit.

This is a 4-bit quantized (GPTQ) version of the GLM-4.6-REAP-268B-A32B model. It is able to run on 8x RTX 3090 (24GB) with -tp 8 and 200K tokens context window using fp8 KV cache.

Downloads · 30 days

20

3% of all-time downloads

All-time downloads

581

Public

Parameters

271B

145 GB on disk

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors145 GB · 100%

Parameter types

How the weights are stored.

I32269B · 99%

Try a prompt

Base models

Task
Text Generation
Library
vllm
Type
glm4_moe
License
mit
Languages
en
Created
Dec 17, 2025
Updated
Dec 20, 2025