Downloads · 30 days
40
10% of all-time downloads
epsil/Tinyllama-1b-v1.0-gguf
Tinyllama-1b-v1.0-gguf is a machine learning model from epsil. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
To run the model run the following code :
Downloads · 30 days
40
10% of all-time downloads
All-time downloads
383
Public
Repo size
1.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf1.2 GB · 100%
From the Hugging Face model README
To run the model run the following code :
!pip install ctransformers[cuda]
from ctransformers import AutoModelForCausalLM
llm = AutoModelForCausalLM.from_pretrained("epsil/Tinyllama-1b-v1.0-gguf", model_file="Tinyllama-1b-v1.0.gguf")
print(llm("AI is going to"))