Downloads · 30 days
140
11% of all-time downloads
lewiswatson/Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged-GGUF
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged-GGUF is a machine learning model from lewiswatson. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
This repository contains GGUF format model files for lewiswatson/Qwen2.5-3B-InstructJohnnySilverhandMerged-GGUF, quantised.
Downloads · 30 days
140
11% of all-time downloads
All-time downloads
1.3K
Public
Repo size
27.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf27.9 GB · 100%
From the Hugging Face model README
This repository contains GGUF format model files for lewiswatson/Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged-GGUF, quantised.
The original fine-tuned model used to generate these quantisations can be found here: lewiswatson/Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged
| File | Size |
|---|---|
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf | 1.63 GB |
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf | 1.19 GB |
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf | 1.59 GB |
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf | 1.48 GB |
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf | 1.35 GB |
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf | 1.80 GB |
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf | 1.71 GB |
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf | 2.07 GB |
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf | 2.02 GB |
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf | 2.36 GB |
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf | 3.06 GB |
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.f16.gguf | 5.75 GB |
This repository was automatically created using a script on 2025-04-14.