Downloads · 30 days
23
33% of all-time downloads
eden-4b-distilled-lora
FrostiSteele/eden-4b-distilled-lora
eden-4b-distilled-lora is a text generation model from FrostiSteele. Use it when you need the model to write or continue text. The card lists the license as mit.
LoRA adapter distilled from Qwen3.5-9B-Instruct (20,000 steps, KL divergence, OpenOrca). Designed to be used with Bartowski's Qwen3.5-4B Q4KM base model.
All-time downloads
70
Public
Repo size
85 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf85 MB · 100%
At a glance
- Task
- Text Generation
- License
- mit
- Access
- Public
- Created
- Jul 25, 2026
- Updated
- Jul 25, 2026
- SHA
- 1e647c6a
Try a prompt
Base models
Model card
From the Hugging Face model README
Eden 4B Distilled LoRA
LoRA adapter distilled from Qwen3.5-9B-Instruct (20,000 steps, KL divergence, OpenOrca). Designed to be used with Bartowski's Qwen3.5-4B Q4_K_M base model.
Usage
# Download base
wget https://huggingface.co/bartowski/Qwen_Qwen3.5-4B-GGUF/resolve/main/Qwen_Qwen3.5-4B-Q4_K_M.gguf
# Run with eden.cpp
./eden-server -m Qwen_Qwen3.5-4B-Q4_K_M.gguf --lora eden-4b-distilled-lora.gguf --port 9094
Training
- Teacher: Qwen3.5-9B-Instruct (BitsAndBytes 4-bit)
- Student: Qwen3.5-4B
- Steps: 20,000
- Loss: KL divergence (T=2.0, α=0.8) + LM loss
- Engine: eden.cpp
Attribution
- Base: Qwen3.5-4B (Apache 2.0)
- LoRA weights: Project Glacie LLC (MIT)
- Task
- Text Generation
- License
- mit
- Languages
- en
- Created
- Jul 25, 2026
- Updated
- Jul 25, 2026