Downloads · 30 days
124
20% of all-time downloads
Aether-2.5-Coder-GGUF
Maxilicious20/Aether-2.5-Coder-GGUF
Aether-2.5-Coder-GGUF is a text generation model from Maxilicious20. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
This repository contains the quantized GGUF format binaries for Aether 2.5 Coder, fine-tuned from Qwen2.5-Coder-3B-Instruct. These files are optimized for local inference using tools like LM Studio, Ollama, Jan, text-…
All-time downloads
608
Public
Repo size
11.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf11.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- Aug 4, 2026
- Updated
- Aug 4, 2026
- SHA
- 34d90660
Base models
Model card
From the Hugging Face model README
Aether 2.5 Coder - GGUF
This repository contains the quantized GGUF format binaries for Aether 2.5 Coder, fine-tuned from Qwen2.5-Coder-3B-Instruct. These files are optimized for local inference using tools like LM Studio, Ollama, Jan, text-generation-webui, or llama.cpp.
🔗 Original LoRA / Adapter Repository: 👉 Maxilicious20/Aether-2.5-Coder
📦 Available Files
| File Name | Quant Method | File Size | Description |
|---|---|---|---|
aether_coder_q4_k_m.gguf | Q4_K_M | ~2.0 GB | Recommended: Best balance between performance, low VRAM usage, and speed. |
aether_coder_q8_0.gguf | Q8_0 | ~3.4 GB | High Quality: Extremely close to 16-bit precision with minimal loss in accuracy. |
aether_coder_f16.gguf | F16 | ~6.2 GB | Uncompressed: Unquantized full-precision GGUF export. |
🚀 How to Use
1. LM Studio / Jan / Local WebUIs
- Download
aether_coder_q4_k_m.gguforaether_coder_q8_0.gguf. - Move the
.gguffile into your local models folder. - Select the model and start chatting or coding!
2. Ollama
Create a custom Modelfile:
FROM ./aether_coder_q4_k_m.gguf
SYSTEM """You are Aether 2.5 Coder, an expert AI programming assistant."""
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Languages
- de, en
- Created
- Aug 4, 2026
- Updated
- Aug 4, 2026