Downloads · 30 days
11
7% of all-time downloads
Phi-3.5-mini-instruct-onnx-cpu
lokinfey/Phi-3.5-mini-instruct-onnx-cpu
Phi-3.5-mini-instruct-onnx-cpu is a machine learning model from lokinfey. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
<b<span style="text-decoration:underline"Note: This is unoffical version,just for test and dev.</span</b
All-time downloads
169
Public
Repo size
2.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.data2.7 GB · 98%
At a glance
- License
- mit
- Model type
- phi3
- Access
- Public
- Created
- Aug 25, 2024
- Updated
- Aug 29, 2024
- SHA
- 587efeeb
Model card
From the Hugging Face model README
Phi-3.5-mini-instruct-onnx-cpu Unofficial version
<b><span style="text-decoration:underline">Note: This is unoffical version,just for test and dev.</span></b>
This is a Phi-3.5-mini-instruct version of ONNX CPU, based on ONNX Runtime for GenAI https://github.com/microsoft/onnxruntime-genai. Convert with the following command
1. Install the SDK
pip install torch transformers onnx onnxruntime
pip install --pre onnxruntime-genai
2. Convert CPU ONNX Support
python3 -m onnxruntime_genai.models.builder -m microsoft/Phi-3.5-mini-instruct -o ./onnx-cpu -p int4 -e cpu -c ./Phi-3.5-mini-instruct
This is a conversion, but no specific optimization has been done. Please look forward to the official version.
- Type
- phi3
- License
- mit
- Created
- Aug 25, 2024
- Updated
- Aug 29, 2024