nisten

bad8bit-13b-instruct-v1

nisten/bad8bit-13b-instruct-v1

bad8bit-13b-instruct-v1 is a machine learning model from nisten. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.

The following bitsandbytes quantization config was used during training: - quantmethod: QuantizationMethod.BITSANDBYTES - loadin8bit: False - loadin4bit: True - llmint8threshold: 6.0 - llmint8skipmodules: None - llmin…