Downloads · 30 days
38
10% of all-time downloads
danbev/hailo-qwen-2.5-GGUF
hailo-qwen-2.5-GGUF is a machine learning model from danbev. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is an experimental GGUF model for Hailo hailo-qwen-2.5 in llama.cpp.
Downloads · 30 days
38
10% of all-time downloads
All-time downloads
383
Public
Repo size
2.5 GB
Likes
1
Public
Click a slice to open those files.
.gguf2.5 GB · 100%
From the Hugging Face model README
This is an experimental GGUF model for Hailo hailo-qwen-2.5 in llama.cpp.
You can use this model with the following branch: hailo.
Clone and build:
$ git clone -b hailo https://github.com/danbev/llama.cpp.git && cd llama.cpp
$ cmake -B build -S . -DGGML_HAILO=ON -DGGML_NATIVE=ON
$ cmake --build build --target llama-cli -j 12
Run:
$ ./build/bin/llama-cli -hf danbev/hailo-qwen-2.5-GGUF