Downloads · 30 days
26
5% of all-time downloads
GTamaraw3-1b
FinchResearch/GTamaraw3-1b
GTamaraw3-1b is a text generation model from FinchResearch. Use it when you need the model to write or continue text. It is set up for transformers.
The following bitsandbytes quantization config was used during training: - quantmethod: bitsandbytes - loadin8bit: False - loadin4bit: True - llmint8threshold: 6.0 - llmint8skipmodules: None - llmint8enablefp32cpuoffl…
All-time downloads
530
Public
Parameters
1.1B
4.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin2.2 GB · 50%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Aug 26, 2023
- Updated
- Aug 26, 2023
- SHA
- 7cd4bb3e
Try a prompt
Model card
From the Hugging Face model README
Training procedure
The following bitsandbytes quantization config was used during training:
- quant_method: bitsandbytes
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: False
- bnb_4bit_compute_dtype: float16
Framework versions
- PEFT 0.6.0.dev0
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Languages
- en
- Created
- Aug 26, 2023
- Updated
- Aug 26, 2023