Downloads · 30 days
6
46% of all-time downloads
bt4103_model_finance
MartinCKY/bt4103_model_finance
bt4103_model_finance is a text generation model from MartinCKY. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as mit.
should probably proofread and complete it, then remove this comment. --
All-time downloads
13
Public
Repo size
120 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors120 MB · 98%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Sep 10, 2024
- Updated
- Nov 6, 2024
- SHA
- dfd541f1
Try a prompt
Base models
Model card
From the Hugging Face model README
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
bt4103_model_finance_trainer
This model is a fine-tuned version of unsloth/phi-3.5-mini-instruct-bnb-4bit on the sujet-ai/Sujet-Finance-Instruct-177k dataset (https://huggingface.co/datasets/sujet-ai/Sujet-Finance-Instruct-177k).
Model description
SLM saved as its orignal full model.
Model Details
Model is used for BT4103 Capstone Project.
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0002
- train_batch_size: 2
- eval_batch_size: 8
- seed: 3407
- gradient_accumulation_steps: 4
- total_train_batch_size: 8
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 5
- training_steps: 60
- mixed_precision_training: Native AMP
Framework versions
- PEFT 0.12.0
- Transformers 4.44.2
- Pytorch 2.4.0+cu121
- Datasets 3.0.0
- Tokenizers 0.19.1
- Task
- Text Generation
- Library
- peft
- Type
- llama
- License
- mit
- Created
- Sep 10, 2024
- Updated
- Nov 6, 2024