Downloads · 30 days
24
5% of all-time downloads
rkstgr/typer-1.5b-instruct-concise-gguf
typer-1.5b-instruct-concise-gguf is a machine learning model from rkstgr. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This repository contains GGUF quantized versions of rkstgr/typer-1.5b-instruct-concise.
Downloads · 30 days
24
5% of all-time downloads
All-time downloads
439
Public
Repo size
3 GB
Likes
0
Public
Click a slice to open those files.
.gguf3 GB · 100%
From the Hugging Face model README
This repository contains GGUF quantized versions of rkstgr/typer-1.5b-instruct-concise.
ollama run hf.co/rkstgr/typer-1.5b-instruct-concise-gguf
# Download the model
wget https://huggingface.co/rkstgr/typer-1.5b-instruct-concise-gguf/resolve/main/{model_file}.gguf
# Run with llama.cpp
./llama-cli -m {model_file}.gguf -p "Your prompt here"
Computational resources were provided by the German AI Service Center WestAI.