gemma-2-2b-dolly-sft

Model Card for gemma-2-2b-dolly-sft

This model is a supervised fine-tuned (SFT) version of Google's Gemma 2 (2B), trained using the databricks/databricks-dolly-15k dataset to enhance instruction-following and conversational capabilities.

Model Details

Model Description

• Developed by: Aditya Anil Raut
• Model type: Causal language model, instruction-tuned transformer
• Language(s) (NLP): English
• License: Apache 2.0 (inheriting base model terms)
• Finetuned from model: google/gemma-2-2b

Model Sources

• Repository: rautaditya/gemma-2-2b-dolly-sft

Uses

Direct Use

This model is intended for general-purpose instruction following, summarization, creative writing, open-ended question answering, and conversational chat interactions.

Out-of-Scope Use

The model is not intended for high-stakes medical, legal, financial advice, or automated critical decision-making without human oversight. It should not be used to generate malicious, harmful, or abusive content.

Bias, Risks, and Limitations

Like all Large Language Models, gemma-2-2b-dolly-sft may exhibit biases inherited from its base model and training data (databricks-dolly-15k). It can occasionally generate inaccurate or "hallucinated" responses.

Recommendations

Users should employ appropriate safety filters and guardrails when deploying this model in public-facing applications.

How to Get Started with the Model

Use the code below to load and run inference with the model using the transformers library:

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "rautaditya/gemma-2-2b-dolly-sft"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto"
)

input_text = "Explain the concept of compound interest in simple terms."
inputs = tokenizer(input_text, return_tensors="pt").to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs, skip_special_tokens=True))