Downloads · 30 days
0
0% of all-time downloads
BAI_Arg_Alpha
varadsrivastava/BAI_Arg_Alpha
BAI_Arg_Alpha is a machine learning model from varadsrivastava. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: varadsrivastava - License: apache-2.0 - Base Model : unsloth/llama-3-8b-Instruct-bnb-4bit
All-time downloads
20
Public
Repo size
671 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors671 MB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- May 27, 2024
- Updated
- Jun 1, 2024
- SHA
- c14feb8e
Base models
Model card
From the Hugging Face model README
Model: BAI_LLM_FinArg
- Developed by: varadsrivastava
- License: apache-2.0
- Base Model : unsloth/llama-3-8b-Instruct-bnb-4bit
For Proper Inference, please use:
!pip install "unsloth[colab-new] @ git+https://GitHub.com/unslothai/unsloth.git
Loading the fine-tuned model and the tokenizer for inference
from unsloth import FastLanguageModel
model, tokenizer = FastLanguageModel.from_pretrained( model_name = "varadsrivastava/BAI_LLM_FinArg", max_seq_length = 20, dtype = torch.bfloat16, load_in_4bit = True )
Using FastLanguageModel for fast inference
FastLanguageModel.for_inference(model)
Prompt template:
"""<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{instruction}<|eot_id|><|start_header_id|>user<|end_header_id|>
Sentence: {row['text']}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
Class: {row['label']}<|eot_id|>"""
NOTE: This model was trained 2x faster using Unsloth and Huggingface's TRL library.
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- May 27, 2024
- Updated
- Jun 1, 2024