Downloads · 30 days
10
14% of all-time downloads
TinyMistral-248M-v2.5-Instruct-orpo
heegyu/TinyMistral-248M-v2.5-Instruct-orpo
TinyMistral-248M-v2.5-Instruct-orpo is a text generation model from heegyu. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
72
Public
Parameters
248M
496 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors496 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Apr 27, 2024
- Updated
- Apr 27, 2024
- SHA
- ec8f4910
Try a prompt
Base models
Model card
From the Hugging Face model README
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("heegyu/TinyMistral-248M-v2.5-Instruct-orpo")
model = AutoModelForCausalLM.from_pretrained("heegyu/TinyMistral-248M-v2.5-Instruct-orpo")
conv = [
{
'role': 'user',
'content': 'What can I do with Large Language Model?'
}
]
prompt = tokenizer.apply_chat_template(conv, add_generation_prompt=True, return_tensors="pt")
output = model.generate(prompt, max_new_token=128)
print(tokenizer.decode(output[0]))
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Created
- Apr 27, 2024
- Updated
- Apr 27, 2024