Downloads · 30 days
11
38% of all-time downloads
tkkagency/together-ft-model
together-ft-model is a machine learning model from tkkagency. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model was fine-tuned using Together.ai's platform.
Downloads · 30 days
11
38% of all-time downloads
All-time downloads
29
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
This model was fine-tuned using Together.ai's platform.
from transformers import AutoModelForCausalLM, AutoTokenizer
# Load the model
model = AutoModelForCausalLM.from_pretrained("tkkagency/together-ft-model")
tokenizer = AutoTokenizer.from_pretrained("tkkagency/together-ft-model")
# Generate text
prompt = "Your prompt here"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=200)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
If this is a LoRA adapter, you'll need to load it with the base model using PEFT:
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
# Load base model (replace with actual base model)
base_model_id = "meta-llama/Llama-2-7b-hf" # Update this!
model = AutoModelForCausalLM.from_pretrained(base_model_id)
tokenizer = AutoTokenizer.from_pretrained(base_model_id)
# Load adapter
model = PeftModel.from_pretrained(model, "tkkagency/together-ft-model")
# Generate
inputs = tokenizer("Your prompt", return_tensors="pt")
outputs = model.generate(**inputs)
print(tokenizer.decode(outputs[0]))