4bit

pyg-7b-4bit-128g-cuda

4bit/pyg-7b-4bit-128g-cuda

pyg-7b-4bit-128g-cuda is a text generation model from 4bit. Use it when you need the model to write or continue text. It is set up for transformers.

Quantized from https://huggingface.co/Neko-Institute-of-Science/pygmalion-7b