Downloads · 30 days
268
16% of all-time downloads
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged-GGUF
lewiswatson/Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged-GGUF
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged-GGUF is a machine learning model from lewiswatson. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
This repository contains GGUF format model files for lewiswatson/Qwen2.5-7B-InstructJohnnySilverhandMerged, quantised.
All-time downloads
1.6K
Public
Repo size
68.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf68.1 GB · 100%
At a glance
- Library
- transformers
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Apr 14, 2025
- Updated
- Apr 14, 2025
- SHA
- a87671ae
Base models
Model card
From the Hugging Face model README
GGUF Quantised Models for Qwen2.5_7B_Instruct_Johnny_Silverhand_Merged
This repository contains GGUF format model files for lewiswatson/Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged, quantised.
Original Model
The original fine-tuned model used to generate these quantisations can be found here: lewiswatson/Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged
Provided Files (GGUF)
| File | Size |
|---|---|
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf | 3.96 GB |
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf | 2.81 GB |
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf | 3.81 GB |
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf | 3.55 GB |
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf | 3.25 GB |
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf | 4.36 GB |
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf | 4.15 GB |
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf | 5.07 GB |
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf | 4.95 GB |
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf | 5.82 GB |
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf | 7.54 GB |
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.f16.gguf | 14.19 GB |
This repository was automatically created using a script on 2025-04-14.
- Library
- transformers
- License
- cc-by-nc-4.0
- Created
- Apr 14, 2025
- Updated
- Apr 14, 2025