Downloads · 30 days
0
0% of all-time downloads
starencoder-coreml
rsvalerio/starencoder-coreml
starencoder-coreml is a feature extraction model from rsvalerio. Use it when you need embeddings to search or compare text. It is set up for coremltools. The card lists the license as apache-2.0.
CoreML conversion of bigcode/starencoder for native Apple Neural Engine / GPU inference on macOS and iOS.
All-time downloads
32
Public
Repo size
247 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin247 MB · 99%
At a glance
- Task
- Feature Extraction
- Library
- coremltools
- License
- apache-2.0
- Access
- Public
- Created
- Mar 25, 2026
- Updated
- Mar 25, 2026
- SHA
- 3e6bcab1
Base models
Model card
From the Hugging Face model README
starencoder — CoreML (.mlpackage)
CoreML conversion of bigcode/starencoder for native Apple Neural Engine / GPU inference on macOS and iOS.
Files
| File | Description |
|---|---|
model.mlpackage/ | CoreML model (FP16, flexible shapes) |
tokenizer.json | HF fast tokenizer |
Details
- Architecture: BERT (encoder-only, trained on The Stack code dataset)
- Precision: FP16 (native ANE precision)
- Compute units:
.all— CoreML schedules across ANE, GPU, and CPU - Input shapes: batch=1..512, seq_len=1..1024 (flexible range)
- Embedding dimension: 768
Usage with cai
cai index --embed-backend swift --embed-model "rsvalerio/starencoder-coreml"
The Swift backend downloads the .mlpackage from this repo, compiles it to .mlmodelc on first run (~30-60s), and caches the compiled model for subsequent runs.
Conversion
Converted using rsvalerio/models CI pipeline with coremltools.
pip install coremltools transformers torch
python convert.py
- Task
- Feature Extraction
- Library
- coremltools
- License
- apache-2.0
- Created
- Mar 25, 2026
- Updated
- Mar 25, 2026