Downloads · 30 days
6
21% of all-time downloads
Llama2_german
Leix1999/Llama2_german
Llama2_german is a text generation model from Leix1999. Use it when you need the model to write or continue text. It is set up for peft.
The following bitsandbytes quantization config was used during training: - loadin8bit: False - loadin4bit: True - llmint8threshold: 6.0 - llmint8skipmodules: None - llmint8enablefp32cpuoffload: False - llmint8hasfp16w…
All-time downloads
28
Public
Repo size
210 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin210 MB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- Access
- Public
- Created
- Aug 28, 2023
- Updated
- Aug 29, 2023
- SHA
- 31319ea9
Try a prompt
Model card
From the Hugging Face model README
Training procedure
The following bitsandbytes quantization config was used during training:
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: True
- bnb_4bit_compute_dtype: bfloat16
Framework versions
- PEFT 0.4.0
- Task
- Text Generation
- Library
- peft
- Created
- Aug 28, 2023
- Updated
- Aug 29, 2023