Downloads · 30 days
76
1% of all-time downloads
fietje-2-instruct-gguf
BramVanroy/fietje-2-instruct-gguf
fietje-2-instruct-gguf is a machine learning model from BramVanroy. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This repository contains quantized versions of BramVanroy/fietje-2-instruct.
All-time downloads
6.2K
Public
Repo size
26.5 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf15.9 GB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Apr 29, 2024
- Updated
- Aug 27, 2024
- SHA
- 082b6cf6
Model card
From the Hugging Face model README
This repository contains quantized versions of BramVanroy/fietje-2-instruct.
Available quantization types and expected performance differences compared to base f16, higher perplexity=worse (from llama.cpp):
Q3_K_M : 3.07G, +0.2496 ppl @ LLaMA-v1-7B
Q4_K_M : 3.80G, +0.0532 ppl @ LLaMA-v1-7B
Q5_K_M : 4.45G, +0.0122 ppl @ LLaMA-v1-7B
Q6_K : 5.15G, +0.0008 ppl @ LLaMA-v1-7B
Q8_0 : 6.70G, +0.0004 ppl @ LLaMA-v1-7B
F16 : 13.00G @ 7B
Also available on ollama.
Quants were made with release b2777 of llama.cpp.
- License
- mit
- Languages
- nl
- Created
- Apr 29, 2024
- Updated
- Aug 27, 2024