BrokenSoul

GPT2-GPTQ-4bit

BrokenSoul/GPT2-GPTQ-4bit

GPT2-GPTQ-4bit is a text generation model from BrokenSoul. Use it when you need the model to write or continue text. It is set up for transformers.

This is a GPT2 Quantized model following this tutorial: 4-bit LLM Quantization with GPTQ.