Downloads · 30 days
254
27% of all-time downloads
mrfakename/Apriel-5B-Instruct-llamafied
Apriel-5B-Instruct-llamafied is a text generation model from mrfakename. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Apriel 5B Instruct (Llamafied) Apriel 5B Base (Llamafied)
Downloads · 30 days
254
27% of all-time downloads
All-time downloads
954
Public
Parameters
4.8B
9.7 GB on disk
Likes
4
Public
Click a slice to open those files.
.safetensors9.7 GB · 100%
From the Hugging Face model README
An approximate conversion of Apriel 5B Instruct to the Llama format.
trust_remote_code requiredUsage:
from transformers import pipeline
import torch
device = 'cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu'
pipe = pipeline('text-generation', model='mrfakename/Apriel-5B-Instruct-llamafied', device=device)
print(pipe(pipe.tokenizer.apply_chat_template([{'role': 'user', 'content': 'Hello'}], tokenize=False, add_generation_prompt=True))[0]['generated_text'])
License: MIT (same as the original Apriel 5B model)