Downloads · 30 days
75
0% of all-time downloads
tiny-llama-miniguanaco-1.5T
Corianas/tiny-llama-miniguanaco-1.5T
tiny-llama-miniguanaco-1.5T is a text generation model from Corianas. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
TinyLLama 1.5T checkpoint trained to answer questions.
All-time downloads
31.8K
Public
Parameters
1.1B
4.4 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.bin2.2 GB · 50%
Parameter types
How the weights are stored.
F161.1B · 100%
Try a prompt
Model card
From the Hugging Face model README
TinyLLama 1.5T checkpoint trained to answer questions.
f"{'prompt'}\n{'completion'}\n<END>"
No special formatting, just question, then newline to begin the answer.
from transformers import pipeline, AutoTokenizer, AutoModelForCausalLM
pipe = pipeline("text-generation", model="Corianas/tiny-llama-miniguanaco-1.5T")# Load model directly
tokenizer = AutoTokenizer.from_pretrained("Corianas/tiny-llama-miniguanaco-1.5T")
model = AutoModelForCausalLM.from_pretrained("Corianas/tiny-llama-miniguanaco-1.5T")
# Run text generation pipeline with our next model
prompt = "What is a large language model?"
pipe = pipeline(task="text-generation", model=model, tokenizer=tokenizer, max_length=500)
result = pipe(f"<s>{prompt}")
print(result[0]['generated_text'])
Result will have the answer, ending with <END> on a new line.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Nov 4, 2023
- Updated
- Nov 18, 2023