Downloads · 30 days
7
33% of all-time downloads
llama2-docqa-v2-downloaded
dhiruHF/llama2-docqa-v2-downloaded
llama2-docqa-v2-downloaded is a text generation model from dhiruHF. Use it when you need the model to write or continue text. It is set up for peft.
The following bitsandbytes quantization config was used during training: - loadin8bit: False - loadin4bit: True - llmint8threshold: 6.0 - llmint8skipmodules: None - llmint8enablefp32cpuoffload: False - llmint8hasfp16w…
All-time downloads
21
Public
Repo size
33.6 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin33.6 MB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- Access
- Public
- Created
- Aug 30, 2023
- Updated
- Aug 30, 2023
- SHA
- f44fcc38
Try a prompt
Model card
From the Hugging Face model README
Model Trained Using AutoTrain## Training procedure
The following bitsandbytes quantization config was used during training:
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: True
- bnb_4bit_compute_dtype: bfloat16
Framework versions
- PEFT 0.4.0
- Task
- Text Generation
- Library
- peft
- Created
- Aug 30, 2023
- Updated
- Aug 30, 2023