Downloads · 30 days
47
3% of all-time downloads
RichardErkhov/Bhooyas_-_tinyllama-dolly-15k-gguf
Bhooyas_-_tinyllama-dolly-15k-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
47
3% of all-time downloads
All-time downloads
1.4K
Public
Repo size
12.7 GB
Likes
0
Public
Click a slice to open those files.
.gguf14.7 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
tinyllama-dolly-15k - GGUF
| Name | Quant method | Size |
|---|---|---|
| tinyllama-dolly-15k.Q2_K.gguf | Q2_K | 0.4GB |
| tinyllama-dolly-15k.IQ3_XS.gguf | IQ3_XS | 0.44GB |
| tinyllama-dolly-15k.IQ3_S.gguf | IQ3_S | 0.47GB |
| tinyllama-dolly-15k.Q3_K_S.gguf | Q3_K_S | 0.47GB |
| tinyllama-dolly-15k.IQ3_M.gguf | IQ3_M | 0.48GB |
| tinyllama-dolly-15k.Q3_K.gguf | Q3_K | 0.51GB |
| tinyllama-dolly-15k.Q3_K_M.gguf | Q3_K_M | 0.51GB |
| tinyllama-dolly-15k.Q3_K_L.gguf | Q3_K_L | 0.55GB |
| tinyllama-dolly-15k.IQ4_XS.gguf | IQ4_XS | 0.57GB |
| tinyllama-dolly-15k.Q4_0.gguf | Q4_0 | 0.59GB |
| tinyllama-dolly-15k.IQ4_NL.gguf | IQ4_NL | 0.6GB |
| tinyllama-dolly-15k.Q4_K_S.gguf | Q4_K_S | 0.6GB |
| tinyllama-dolly-15k.Q4_K.gguf | Q4_K | 0.62GB |
| tinyllama-dolly-15k.Q4_K_M.gguf | Q4_K_M | 0.62GB |
| tinyllama-dolly-15k.Q4_1.gguf | Q4_1 | 0.65GB |
| tinyllama-dolly-15k.Q5_0.gguf | Q5_0 | 0.71GB |
| tinyllama-dolly-15k.Q5_K_S.gguf | Q5_K_S | 0.71GB |
| tinyllama-dolly-15k.Q5_K.gguf | Q5_K | 0.73GB |
| tinyllama-dolly-15k.Q5_K_M.gguf | Q5_K_M | 0.73GB |
| tinyllama-dolly-15k.Q5_1.gguf | Q5_1 | 0.77GB |
| tinyllama-dolly-15k.Q6_K.gguf | Q6_K | 0.84GB |
| tinyllama-dolly-15k.Q8_0.gguf | Q8_0 | 1.09GB |
license: apache-2.0 datasets:
The TinyLlama Dolly 15k is a specialized large language model finely tuned on the Databricks Dolly 15k dataset. This dataset, composed of 15,000 high-quality, human-curated prompts and responses, helps the model excel in understanding and generating contextually relevant and coherent text. By leveraging this diverse and comprehensive dataset, TinyLlama Dolly 15k enhances its ability to engage in nuanced conversations and provide accurate, context-aware responses across a range of topics. The result is a powerful tool for applications requiring advanced natural language understanding and generation.
How to use
Below is a snippet that can be used to test the model.
from transformers import pipeline
pipe = pipeline("text-generation", model="Bhooyas/tinyllama-dolly-15k", device_map="auto")
messages = [
{
"role": "user",
"context": "The TinyLlama Dolly 15k is a specialized large language model finely tuned on the Databricks Dolly 15k dataset. This dataset, composed of 15,000 high-quality, human-curated prompts and responses, helps the model excel in understanding and generating contextually relevant and coherent text. By leveraging this diverse and comprehensive dataset, TinyLlama Dolly 15k enhances its ability to engage in nuanced conversations and provide accurate, context-aware responses across a range of topics. The result is a powerful tool for applications requiring advanced natural language understanding and generation.",
"instruction": "What is TinyLlama Dolly 15k?"
}
]
prompt = pipe.tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
outputs = pipe(prompt, max_new_tokens=256)
print(outputs[0]["generated_text"])