Downloads · 30 days
14
11% of all-time downloads
KodaLite-1.3B-mlx-8bit
YoAbriel/KodaLite-1.3B-mlx-8bit
KodaLite-1.3B-mlx-8bit is a text generation model from YoAbriel. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
8-bit MLX quantization of YoAbriel/KodaLite-1.3B, optimized for Apple Silicon.
All-time downloads
125
Public
Parameters
1.3B
2.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.3 GB · 100%
Parameter types
How the weights are stored.
U321.3B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
KodaLite-1.3B — MLX 8-bit
8-bit MLX quantization of YoAbriel/KodaLite-1.3B, optimized for Apple Silicon.
Size: ~1.4 GB | Precision: 8-bit (8.5 bpw)
Usage
pip install mlx-lm
from mlx_lm import load, generate
model, tok = load("YoAbriel/KodaLite-1.3B-mlx-8bit")
prompt = tok.apply_chat_template(
[{"role": "user", "content": "What is the capital of France?"}],
tokenize=False,
add_generation_prompt=True,
)
print(generate(model, tok, prompt=prompt, max_tokens=80))
Related
- YoAbriel/KodaLite-1.3B-mlx — Full precision fp16 (~2.5 GB)
Note: 4-bit quantization of this model produces degraded output because the SFT signal is weak at 1.27B params with only 1.64B training tokens. 8-bit works fine.
License
Apache 2.0
- Task
- Text Generation
- Library
- mlx
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Apr 17, 2026
- Updated
- May 4, 2026