Downloads · 30 days
0
ryzen-ai-llms
NaritaToproad/ryzen-ai-llms
ryzen-ai-llms is a machine learning model from NaritaToproad. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
The models are quantized & tested via Ryzen AI SW 1.2.
Access
Public
Updated Aug 30, 2024
Repo size
129 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.pth73 GB · 96%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Aug 23, 2024
- Updated
- Aug 30, 2024
- SHA
- 5f20e7ef
Model card
From the Hugging Face model README
Optmized LLM models for Ryzen AI.
The models are quantized & tested via Ryzen AI SW 1.2.
The folder quantized_models contains a set of LLMs quantized via different algorithms.
The folder onnx_model_nodes contains the mlp.up_proj nodes for -npugpu device parallel config.
Due to the disordered Ryzen AI Python environment, you may need to install different versions of transformers:
transformers==4.37.2 # Others
transformers==4.39.1 # GEMMA
transformers>=4.42 # Mistral
- License
- apache-2.0
- Created
- Aug 23, 2024
- Updated
- Aug 30, 2024