Downloads · 30 days
158
35% of all-time downloads
PocketWeights/PocketWeights-Qwen2.5-14B-Coder-Creative-GGUF
PocketWeights-Qwen2.5-14B-Coder-Creative-GGUF is a text generation model from PocketWeights. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
Heavy models, made light. PocketWeights optimizes state-of-the-art open-source LLMs into efficient GGUF formats so you can run unrestricted, powerful AI locally on consumer hardware, gaming laptops, and edge devices.
Downloads · 30 days
158
35% of all-time downloads
All-time downloads
452
Public
Repo size
36.8 GB
Likes
0
Public
Click a slice to open those files.
.gguf36.8 GB · 100%
From the Hugging Face model README
Heavy models, made light. PocketWeights optimizes state-of-the-art open-source LLMs into efficient GGUF formats so you can run unrestricted, powerful AI locally on consumer hardware, gaming laptops, and edge devices.
These are the official, first-party GGUF quantizations of PocketWeights-Qwen2.5-14B-Coder-Creative.
This model is a cross-domain synthesis engineered to solve a common trade-off in mid-sized language models. Using the DARE-TIES algorithm, we injected the high-density coding logic of Qwen2.5-Coder-14B directly into an uncensored, extended-context Qwen2.5-14B-abliterated foundation.
⚠️ Disclaimer: This model has had its corporate safety guardrails removed. It is designed for researchers, writers, and developers operating in secure, local environments.
We provide highly curated, precision-focused files—no clutter, just the formats you actually need.
| Quant Format | File Size | Recommended Hardware | Best For |
|---|---|---|---|
| Q4_K_M | ~8.9 GB | 12 GB VRAM / 16 GB RAM | The Balanced Standard. The community sweet spot offering maximum speed and high intelligence for RTX 3060, RTX 4070, and 16GB MacBooks. |
| Q6_K | ~12.1 GB | 16 GB VRAM / 24 GB RAM | Near-Lossless Quality. Maximizes coding syntax accuracy and vocabulary richness for RTX 4080 and high-end desktop rigs. |
| Q8_0 | ~15.7 GB | 24 GB VRAM / 32 GB RAM | Enterprise Fidelity. Practically indistinguishable from the base model. Ideal for RTX 3090/4090 or Apple Silicon (M1/M2/M3 Max). |
You can run this model offline on your local machine in under 2 minutes:
PocketWeights/PocketWeights-Qwen2.5-14B-Coder-Creative-GGUFRun the balanced tier immediately from your terminal (Ollama will automatically pull the Q4_K_M):
ollama run hf.co/PocketWeights/PocketWeights-Qwen2.5-14B-Coder-Creative-GGUF
Execute directly via llama.cpp, offloading maximum layers to your GPU:
llama-cli -m PocketWeights-14B-Coder-Creative-Q4_K_M.gguf -p "Write a Python script using scapy to analyze packet headers." -ngl 40
I build, verify, and maintain these quantization pipelines to provide high-quality, unrestricted, and hardware-friendly models to the open-source community for free.
Running conversion setups, cloud instances, and storage requires ongoing resources. If these weights have saved you time, compute overhead, or API bills, please consider supporting the project with a small tip!
Ko-fi: ko-fi.com/iamvishalnarayan
Web3 / Crypto (Polygon / ETH):
0x4FC189bf839A89259dd28DE8cD97883c49e15615
Tip: Sending via the Polygon network keeps transfer gas fees below $0.01!
Synthesis Lab: PocketWeights
Base Architecture: Alibaba Cloud (Qwen2.5)
Abliteration Source: qq591503 / huihui-ai
License: Apache-2.0