Downloads · 30 days
5
33% of all-time downloads
midjourney-falcon-7b
Kdffff/midjourney-falcon-7b
midjourney-falcon-7b is a text generation model from Kdffff. Use it when you need the model to write or continue text. It is set up for peft.
This model is designed for text generation using LoRA.
All-time downloads
15
Public
Repo size
18.9 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin18.9 MB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- Access
- Public
- Created
- Jun 17, 2024
- Updated
- Jun 17, 2024
- SHA
- 2701df35
Try a prompt
Model card
From the Hugging Face model README
My Model
This model is designed for text generation using LoRA.
Training procedure
The following bitsandbytes quantization config was used during training:
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: True
- bnb_4bit_compute_dtype: bfloat16
Framework versions
- PEFT 0.4.0
- Task
- Text Generation
- Library
- peft
- Created
- Jun 17, 2024
- Updated
- Jun 17, 2024