Downloads · 30 days
13
4% of all-time downloads
falcon-med-FT-v1.114
shuvom/falcon-med-FT-v1.114
falcon-med-FT-v1.114 is a text generation model from shuvom. Use it when you need the model to write or continue text. It is set up for transformers.
The following bitsandbytes quantization config was used during training: - quantmethod: bitsandbytes - loadin8bit: False - loadin4bit: True - llmint8threshold: 6.0 - llmint8skipmodules: None - llmint8enablefp32cpuoffl…
All-time downloads
306
Public
Repo size
9.5 MB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin9.5 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Access
- Public
- Created
- Aug 21, 2023
- Updated
- Aug 24, 2023
- SHA
- 0b80a7c3
Try a prompt
Datasets
Model card
From the Hugging Face model README
Training procedure
The following bitsandbytes quantization config was used during training:
- quant_method: bitsandbytes
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: True
- bnb_4bit_compute_dtype: bfloat16
Framework versions
- PEFT 0.5.0.dev0
Citation
@misc {shuvam_mandal_2023, author = { {shuvam mandal} }, title = { falcon-med-FT-v1.114 (Revision 87e4f8f) }, year = 2023, url = { https://huggingface.co/shuvom/falcon-med-FT-v1.114 }, doi = { 10.57967/hf/1012 }, publisher = { Hugging Face } }
- Task
- Text Generation
- Library
- transformers
- Languages
- en
- Created
- Aug 21, 2023
- Updated
- Aug 24, 2023