Downloads · 30 days
24
23% of all-time downloads
magiccodingman/Jasper-Token-Compression-600M-ONNX-FP32
Jasper-Token-Compression-600M-ONNX-FP32 is a sentence similarity model from magiccodingman. Use it when you need a score for how close two texts are. It is set up for sentence-transformers. The card lists the license as apache-2.0.
ONNX export of infgrad/Jasper-Token-Compression-600M.
Downloads · 30 days
24
23% of all-time downloads
All-time downloads
104
Public
Repo size
2.4 GB
Likes
0
Public
Click a slice to open those files.
.data2.4 GB · 99%
From the Hugging Face model README
ONNX export of infgrad/Jasper-Token-Compression-600M.
Precision: FP32
Quantization: None (FP32)
Model size: 2.26 GiB
Full-precision FP32 ONNX export. This is the reference model used for the included quantization fidelity comparisons.
| Tokens | Median latency | Tokens/s |
|---|---|---|
| 32 | 139.282 ms | 229.7 |
| 128 | 155.466 ms | 823.3 |
| 512 | 211.763 ms | 2,417.8 |
| 1024 | 288.388 ms | 3,550.8 |
Original model: infgrad/Jasper-Token-Compression-600M