Downloads · 30 days
0
gemma-2-9b-bnb-absa_v2
helixx999/gemma-2-9b-bnb-absa_v2
gemma-2-9b-bnb-absa_v2 is a machine learning model from helixx999. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: helixx999 (Harsh Jain) - License: apache-2.0 - Finetuned from model : unsloth/gemma-2-9b-bnb-4bit
Access
Public
Updated Aug 23, 2024
Repo size
238 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors216 MB · 91%
At a glance
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Aug 23, 2024
- Updated
- Aug 23, 2024
- SHA
- 8783b549
Base models
Model card
From the Hugging Face model README
Uploaded model
- Developed by: helixx999 (Harsh Jain)
- License: apache-2.0
- Finetuned from model : unsloth/gemma-2-9b-bnb-4bit
This is gemma2 trained on semeval restaurant data 2014 using unsloth framework.
Training Parameters:
per_device_train_batch_size = 2,
gradient_accumulation_steps = 4,
warmup_steps = 6, #Previous 5
max_steps = 60,
#learning_rate = 2e-4,
learning_rate = 1e-4,
fp16 = not is_bfloat16_supported(),
bf16 = is_bfloat16_supported(),
logging_steps = 1,
optim = "adamw_8bit",
weight_decay = 0.01,
lr_scheduler_type = "linear",
seed = 3407,
output_dir = "./tensorLog",
report_to="wandb"
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- Aug 23, 2024
- Updated
- Aug 23, 2024