Downloads · 30 days
16
19% of all-time downloads
Phi-3-mini-4k-instruct-onnx-directml
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-directml
Phi-3-mini-4k-instruct-onnx-directml is a text generation model from EmbeddedLLM. Use it when you need the model to write or continue text. It is set up for transformers.
We measured the performance of DirectML on AMD Ryzen 9 7940HS /w Radeon 78
All-time downloads
86
Public
Repo size
2.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.data2.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- phi3
- Access
- Public
- Created
- Jul 17, 2024
- Updated
- Aug 12, 2024
- SHA
- ae1dd130
Try a prompt
Model card
From the Hugging Face model README
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-directml
Performance Metrics
<!-- These are the evaluation metrics being used, ideally with a description of why. -->DirectML
We measured the performance of DirectML on AMD Ryzen 9 7940HS /w Radeon 78
| Prompt Length | Generation Length | Average Throughput (tps) |
|---|---|---|
| 128 | 128 | - |
| 128 | 256 | - |
| 128 | 512 | - |
| 128 | 1024 | - |
| 256 | 128 | - |
| 256 | 256 | - |
| 256 | 512 | - |
| 256 | 1024 | - |
| 512 | 128 | - |
| 512 | 256 | - |
| 512 | 512 | - |
| 512 | 1024 | - |
| 1024 | 128 | - |
| 1024 | 256 | - |
| 1024 | 512 | - |
| 1024 | 1024 | - |
- Task
- Text Generation
- Library
- transformers
- Type
- phi3
- Languages
- en
- Created
- Jul 17, 2024
- Updated
- Aug 12, 2024