Aether-2.5-GGUF

Aether 2.5 - GGUF

Pre-quantized GGUF binaries for Aether 2.5, scaling up to the powerful Qwen2.5-3B-Instruct base architecture.

Trained with SFT (Supervised Fine-Tuning) and PEFT (LoRA) on a custom 3 GB dataset using local NVIDIA RTX GPU acceleration, Aether 2.5 delivers high intelligence, robust conversational capabilities, and exceptional multilingual performance in German and English.

🔗 Looking for the Base / LoRA Adapter? If you want to use the Hugging Face Transformers PEFT adapter instead, check out the main repository: 👉 Maxilicious20/Aether-2.5

---

📦 Available Files & Quantizations

Choose the right file depending on your system's VRAM/RAM and performance needs:

---

🚀 How to Run Locally

1. LM Studio

1. Open LM Studio.
2. Search for Maxilicious20/Aether-2.5-GGUF or paste the repo ID.
3. Download your preferred quantization (e.g., Aether-2.5-3B-Q4_K_M.gguf).
4. Load the model and start chatting!

2. Ollama / llama.cpp

You can run the GGUF file directly using llama.cpp:

./llama-cli -m Aether-2.5-3B-Q4_K_M.gguf -p "Hello Aether!" -n 256