poseidon-rust2

Llama-2-7B-GPTQ-QLora

poseidon-rust2/Llama-2-7B-GPTQ-QLora

Llama-2-7B-GPTQ-QLora is a machine learning model from poseidon-rust2. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.

The following bitsandbytes quantization config was used during training: - quantmethod: gptq - bits: 4 - tokenizer: None - dataset: None - groupsize: 128 - damppercent: 0.01 - descact: False - sym: True - truesequenti…