Downloads · 30 days
110
8% of all-time downloads
Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged-GGUF
lewiswatson/Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged-GGUF
Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged-GGUF is a machine learning model from lewiswatson. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
This repository contains GGUF format model files for lewiswatson/Qwen2.5-0.5B-InstructJohnnySilverhandMerged, quantised.
All-time downloads
1.4K
Public
Repo size
5.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf5.4 GB · 100%
At a glance
- Library
- transformers
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Apr 14, 2025
- Updated
- Apr 14, 2025
- SHA
- d8cdcc53
Base models
Model card
From the Hugging Face model README
GGUF Quantised Models for Qwen2.5_0.5B_Instruct_Johnny_Silverhand_Merged
This repository contains GGUF format model files for lewiswatson/Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged, quantised.
Original Model
The original fine-tuned model used to generate these quantisations can be found here: lewiswatson/Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged
Provided Files (GGUF)
| File | Size |
|---|---|
Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf | 335.16 MB |
Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf | 322.92 MB |
Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf | 352.25 MB |
Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf | 339.00 MB |
Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf | 322.59 MB |
Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf | 379.38 MB |
Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf | 367.61 MB |
Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf | 400.62 MB |
Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf | 393.59 MB |
Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf | 482.31 MB |
Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf | 506.47 MB |
Qwen2.5-0.5B-Instruct_Johnny_Silverhand_Merged.f16.gguf | 948.10 MB |
This repository was automatically created using a script on 2025-04-14.
- Library
- transformers
- License
- cc-by-nc-4.0
- Created
- Apr 14, 2025
- Updated
- Apr 14, 2025