chanderbalaji

llama2-7b-sharded-qlora-ft-guanaco

chanderbalaji/llama2-7b-sharded-qlora-ft-guanaco

llama2-7b-sharded-qlora-ft-guanaco is a text generation model from chanderbalaji. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.

The following bitsandbytes quantization config was used during training: - loadin8bit: False - loadin4bit: True - llmint8threshold: 6.0 - llmint8skipmodules: None - llmint8enablefp32cpuoffload: False - llmint8hasfp16w…