Downloads · 30 days
10
25% of all-time downloads
falcon-7b-sharded-bf16_tp_v1
andinho/falcon-7b-sharded-bf16_tp_v1
falcon-7b-sharded-bf16_tp_v1 is a text generation model from andinho. Use it when you need the model to write or continue text. It is set up for peft.
The following bitsandbytes quantization config was used during training: - loadin8bit: False - loadin4bit: True - llmint8threshold: 6.0 - llmint8skipmodules: None - llmint8enablefp32cpuoffload: False - llmint8hasfp16w…
All-time downloads
40
Public
Repo size
522 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin522 MB · 99%
At a glance
- Task
- Text Generation
- Library
- peft
- Access
- Public
- Created
- Jun 28, 2023
- Updated
- Jun 29, 2023
- SHA
- 240c9219
Try a prompt
Model card
From the Hugging Face model README
Training procedure
The following bitsandbytes quantization config was used during training:
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: False
- bnb_4bit_compute_dtype: float16
Framework versions
- PEFT 0.4.0.dev0
Notes:
fine-tuning parameters:
- epochs: 3 (default)
- learning_rate: 2e-4 (default)
- Task
- Text Generation
- Library
- peft
- Created
- Jun 28, 2023
- Updated
- Jun 29, 2023