Downloads · 30 days
4
4% of all-time downloads
miladatefi/LLM-matefi-GGUF
LLM-matefi-GGUF is a machine learning model from miladatefi. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
A fine-tuned TinyLlama 1.1B model for German & English Q&A. Quantized with llama.cpp to Q5KM.
Downloads · 30 days
4
4% of all-time downloads
All-time downloads
94
Public
Repo size
782 MB
Likes
0
Public
Click a slice to open those files.
.gguf782 MB · 100%
From the Hugging Face model README
A fine-tuned TinyLlama 1.1B model for German & English Q&A. Quantized with llama.cpp to Q5_K_M.
./llama-cli -m LLM-matefi.Q5_K_M.gguf -c 2048 -n 256 -p "<|system|>\nReply in German or English.\n<|user|>\nWhat is PowerShell?\n<|assistant|>\n"
dotnet run -- "C:\models\LLM-matefi.Q5_K_M.gguf"