YegorS

llama_2_13b_8bit_r16

YegorS/llama_2_13b_8bit_r16

llama_2_13b_8bit_r16 is a machine learning model from YegorS. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.

The following bitsandbytes quantization config was used during training: - loadin8bit: True - loadin4bit: False - llmint8threshold: 6.0 - llmint8skipmodules: None - llmint8enablefp32cpuoffload: False - llmint8hasfp16w…