Downloads · 30 days
15
5% of all-time downloads
Phi-3-medium-128k-instruct-onnx-directml
EmbeddedLLM/Phi-3-medium-128k-instruct-onnx-directml
Phi-3-medium-128k-instruct-onnx-directml is a text generation model from EmbeddedLLM. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
We measured the performance of DirectML on AMD Ryzen 9 7940HS /w Radeon 78
All-time downloads
280
Public
Repo size
7.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.data7.5 GB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- phi3
- Access
- Public
- Created
- Jul 18, 2024
- Updated
- Jul 19, 2024
- SHA
- 8a0a6596
Try a prompt
Model card
From the Hugging Face model README
EmbeddedLLM/Phi-3-medium-128k-instruct-onnx-directml
Performance Metrics
<!-- These are the evaluation metrics being used, ideally with a description of why. -->DirectML
We measured the performance of DirectML on AMD Ryzen 9 7940HS /w Radeon 78
| Prompt Length | Generation Length | Average Throughput (tps) |
|---|---|---|
| 128 | 128 | - |
| 128 | 256 | - |
| 128 | 512 | - |
| 128 | 1024 | - |
| 256 | 128 | - |
| 256 | 256 | - |
| 256 | 512 | - |
| 256 | 1024 | - |
| 512 | 128 | - |
| 512 | 256 | - |
| 512 | 512 | - |
| 512 | 1024 | - |
| 1024 | 128 | - |
| 1024 | 256 | - |
| 1024 | 512 | - |
| 1024 | 1024 | - |
- Task
- Text Generation
- Library
- transformers
- Type
- phi3
- License
- mit
- Languages
- en
- Created
- Jul 18, 2024
- Updated
- Jul 19, 2024