Downloads · 30 days
6
3% of all-time downloads
coreml-joint-compression-test
smpanaro/coreml-joint-compression-test
coreml-joint-compression-test is a machine learning model from smpanaro. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Series of models to test the benefits of CoreML joint compression on iOS 18/macOS 15.
All-time downloads
202
Public
Repo size
2.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin2.4 GB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Jul 29, 2024
- Updated
- Jul 30, 2024
- SHA
- ea8ec06c
Model card
From the Hugging Face model README
Series of models to test the benefits of CoreML joint compression on iOS 18/macOS 15.
mlp-*.mlpackage
Simple Up/Gate/Silu/Down MLP repeated four times with the Llama 2 7B dimensions.
All using 'CPU and Neural Engine' compute unit, measured in Xcode.
| Device | Model | Precision | Minimum (ms) | Median (ms) |
|---|---|---|---|---|
| M1 Max | mlp-float16 | float16 | 19.30 | 19.42 |
| M1 Max | mlp-4bit | 4-bit LUT | 5.93 | 5.98 |
| M1 Max | mlp-2bit | 2-bit LUT | 5.92 | 6.11 |
| M1 Max | mlp-4bit-int8 | 4-bit int8 LUT + A8 | 6.02 | 6.31 |
| M1 Max | mlp-2bit-int8 | 2-bit int8 LUT + A8 | 6.00 | 6.18 |
| M1 Max | mlp-int8-int8 | W8A8 | 9.78 | 9.94 |
| M4 | mlp-4bit | 4-bit LUT | - | 4.19 |
| M4 | mlp-2bit | 2-bit LUT | - | 3.83 |
| M4 | mlp-4bit-int8 | 4-bit int8 LUT + A8 | - | 4.14 |
| M4 | mlp-2bit-int8 | 2-bit int8 LUT + A8 | - | 3.83 |
| M4 | mlp-int8-int8 | W8A8 | - | 8.18 |
Download
huggingface-cli download \
--local-dir . \
--local-dir-use-symlinks False \
smpanaro/coreml-joint-compression-test \
--include "*.mlpackage/*"
- License
- mit
- Created
- Jul 29, 2024
- Updated
- Jul 30, 2024