Downloads · 30 days
221
22% of all-time downloads
djrsystemservices/Ling-3.0-tiny-oQ6e
Ling-3.0-tiny-oQ6e is a text generation model from djrsystemservices. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as mit.
This is an oQ6e MLX conversion produced with oMLX.
Downloads · 30 days
221
22% of all-time downloads
All-time downloads
1K
Public
Parameters
7.9B
6.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.6 GB · 100%
How the weights are stored.
U327.9B · 100%
From the Hugging Face model README
This is an oQ6e MLX conversion produced with oMLX.
Ling-3.0-tiny-bf16Please follow the original model's license, acceptable-use policy, and attribution requirements.
enhanced=True)oQe uses an imatrix sensitivity calibration to assign precision selectively,
rather than applying a uniform bit-width to every tensor. The generated
oq_imatrix_report.json records the resulting quantization allocation.
python run_oqe_conversion.py Ling-3.0-tiny-bf16 --models-dir /path/to/models --oq-level 6.0 --imatrix-samples 128 --imatrix-seq-length 512 --source-repo https://huggingface.co/inclusionAI/Ling-3.0-tiny
model*.safetensors: quantized MLX weightsmodel.safetensors.index.json: shard indexconfig.json: model configurationoq_imatrix_report.json: imatrix calibration and quantization report