Downloads · 30 days
0
0% of all-time downloads
codellama_trial_v1
SJ182120/codellama_trial_v1
codellama_trial_v1 is a text generation model from SJ182120. Use it when you need the model to write or continue text. It is set up for peft.
The following bitsandbytes quantization config was used during training: - loadin8bit: False - loadin4bit: True - llmint8threshold: 6.0 - llmint8skipmodules: None - llmint8enablefp32cpuoffload: False - llmint8hasfp16w…
All-time downloads
1
Public
Repo size
67.7 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin67.2 MB · 99%
At a glance
- Task
- Text Generation
- Library
- peft
- Access
- Public
- Created
- Feb 13, 2024
- Updated
- Feb 13, 2024
- SHA
- a05c7817
Model card
From the Hugging Face model README
Training procedure
The following bitsandbytes quantization config was used during training:
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: False
- bnb_4bit_compute_dtype: float16
Framework versions
- PEFT 0.4.0
- Task
- Text Generation
- Library
- peft
- Languages
- code
- Created
- Feb 13, 2024
- Updated
- Feb 13, 2024