Downloads · 30 days
0
onurSakar/Llama-3-8b-sql_fine_tuning
Llama-3-8b-sql_fine_tuning is a text generation model from onurSakar. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
meta-llama/Meta-Llama-3-8B <br perdevicetrainbatchsize = 2 <br gradientaccumulationsteps = 2 <br optim = "pagedadamw32bit" <br savesteps = 1000 <br loggingsteps = 10 <br learningrate = 2e-4 <br maxgradnorm = 0.3 <br m…
Downloads · 30 days
0
Access
Public
Updated Apr 28, 2024
Repo size
3.4 MB
Likes
0
Public
Click a slice to open those files.
.safetensors3.4 MB · 100%
From the Hugging Face model README
meta-llama/Meta-Llama-3-8B <br> per_device_train_batch_size = 2 <br> gradient_accumulation_steps = 2 <br> optim = "paged_adamw_32bit" <br> save_steps = 1000 <br> logging_steps = 10 <br> learning_rate = 2e-4 <br> max_grad_norm = 0.3 <br> max_steps = 1400 <br> warmup_ratio = 0.03 <br> lora_alpha = 4 <br> lora_dropout = 0.1 <br> lora_r = 2 <br>
token size = 99191 <br> row = 1303 <br> word count = 45616 <br> prompt=[INST]<<SYS>>Aşağıda bir SQL görevi açıklayan bir talimat bulunmaktadır. İsteği uygun şekilde tamamlayan bir yanıt yazın <</SYS>> ürün tablosundan 10. numaralı tedarikçinin sağladığı ürün sayısı kaçtır [/INST]SELECT COUNT (*) FROM Products INNER JOIN Suppliers ON products.SupplierID=suppliers.SupplierID WHERE products.SupplierID=10