Downloads · 30 days
17
14% of all-time downloads
Chuxia-sys/lora-tuned-planner
lora-tuned-planner is a text generation model from Chuxia-sys. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: Chuxia-sys - License: apache-2.0 - Finetuned from model : unsloth/mistral-7b-v0.3-bnb-4bit
Downloads · 30 days
17
14% of all-time downloads
All-time downloads
122
Public
Parameters
7.5B
4.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors4.1 GB · 100%
How the weights are stored.
U87.2B · 96%
From the Hugging Face model README
This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.
Fine-tuned Mistral-7B for travel planning using Unsloth + LoRA.
from transformers import AutoTokenizer, AutoModelForCausalLM
model_name = "Chuxia-sys/Lora_tuned_planner"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto")
prompt = "Plan a 3-day trip to Kyoto..."
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=512)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))