Downloads · 30 days
5
33% of all-time downloads
ludwig-webinar
hessertaboada/ludwig-webinar
ludwig-webinar is a text generation model from hessertaboada. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as llama2.
The following bitsandbytes quantization config was used during training: - quantmethod: bitsandbytes - loadin8bit: False - loadin4bit: True - llmint8threshold: 6.0 - llmint8skipmodules: None - llmint8enablefp32cpuoffl…
All-time downloads
15
Public
Repo size
33.6 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin16.8 MB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- llama2
- Access
- Public
- Created
- Aug 29, 2023
- Updated
- Aug 29, 2023
- SHA
- 7a71aaae
Model card
From the Hugging Face model README
Training procedure
The following bitsandbytes quantization config was used during training:
- quant_method: bitsandbytes
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: True
- bnb_4bit_compute_dtype: float16
The following bitsandbytes quantization config was used during training:
- quant_method: bitsandbytes
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: True
- bnb_4bit_compute_dtype: float16
Framework versions
-
PEFT 0.5.0
-
PEFT 0.5.0
- Task
- Text Generation
- Library
- peft
- License
- llama2
- Languages
- code
- Created
- Aug 29, 2023
- Updated
- Aug 29, 2023