Downloads · 30 days
15
3% of all-time downloads
danbev/hailo-llama-3.2-GGUF
hailo-llama-3.2-GGUF is a machine learning model from danbev. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is an experimental GGUF model for Hailo hailo-llama-3.2 in llama.cpp.
Downloads · 30 days
15
3% of all-time downloads
All-time downloads
454
Public
Repo size
1.4 GB
Likes
2
Public
Click a slice to open those files.
.gguf1.4 GB · 100%
From the Hugging Face model README
This is an experimental GGUF model for Hailo hailo-llama-3.2 in llama.cpp.
You can use this model with the following branch: hailo.
Clone and build:
$ git clone -b hailo https://github.com/danbev/llama.cpp.git && cd llama.cpp
$ cmake -B build -S . -DGGML_HAILO=ON -DGGML_NATIVE=ON
$ cmake --build build --target llama-cli -j 12
Run:
$ ./build/bin/llama-cli -hf danbev/hailo-llama-3.2-GGUF