Downloads · 30 days
5
14% of all-time downloads
falcon-7b-sharded-bf16_tp_v2
andinho/falcon-7b-sharded-bf16_tp_v2
falcon-7b-sharded-bf16_tp_v2 is a text generation model from andinho. Use it when you need the model to write or continue text. It is set up for peft.
The following bitsandbytes quantization config was used during training: - loadin8bit: False - loadin4bit: True - llmint8threshold: 6.0 - llmint8skipmodules: None - llmint8enablefp32cpuoffload: False - llmint8hasfp16w…
All-time downloads
36
Public
Repo size
522 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin522 MB · 99%
At a glance
- Task
- Text Generation
- Library
- peft
- Access
- Public
- Created
- Jun 29, 2023
- Updated
- Jun 29, 2023
- SHA
- d9317734
Try a prompt
Model card
From the Hugging Face model README
Training procedure
The following bitsandbytes quantization config was used during training:
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: False
- bnb_4bit_compute_dtype: float16
Framework versions
- PEFT 0.4.0.dev0
Notes:
fine-tuning parameters:
- epochs: 1 (default)
- learning_rate: 1e-4 (default)
license: apache-2.0
- Task
- Text Generation
- Library
- peft
- Created
- Jun 29, 2023
- Updated
- Jun 29, 2023