Downloads · 30 days
37
100% of all-time downloads
oxcoder-9b-oq6e
IDFluff/oxcoder-9b-oq6e
oxcoder-9b-oq6e is a machine learning model from IDFluff. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx.
All-time downloads
37
Public
Parameters
9.4B
8.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.3 GB · 100%
Parameter types
How the weights are stored.
U329B · 95%
Base models
Model card
From the Hugging Face model README
about
oq6e quantized version of OxCoder
imatrix used
Default oMLX imatrix
rough performance metrics from quick tests/benchmarks
- roughly 445 tks/s prefill, 16 tk/s decode on m3 pro 36gb ram in practice on a fresh pi agent
- context benchmark from omlx for 131k context length started at 2k t/s prefill, finished at ~600 t/s
- throughput benchmark did not upload because of certain flags used but roughly matched above numbers at 128k
- ANE prefill with tweaked settings
- SpecPrefill with qwen3.5 0.8b model
omlx throughput test with ane prefill disabled
https://omlx.ai/benchmarks/performance/tflpzdtq
omlx version used
0.7.0 dev4
- Library
- mlx
- Type
- qwen3_5
- Created
- Sep 21, 2026
- Updated
- Sep 21, 2026