finetune-960f912e

finetune-960f912e

Fine-tuned version of mistralai/Mistral-7B-Instruct-v0.2 using SFT.

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("Canfield/finetune-960f912e")
tokenizer = AutoTokenizer.from_pretrained("Canfield/finetune-960f912e")

# Generate text
messages = [
    {"role": "user", "content": "Hello, how are you?"}
]
inputs = tokenizer.apply_chat_template(messages, return_tensors="pt")
outputs = model.generate(inputs, max_new_tokens=100)
print(tokenizer.decode(outputs[0]))

Training Details

• Method: SFT
• Base Model: mistralai/Mistral-7B-Instruct-v0.2
• LoRA merged and quantization removed for inference compatibility