Downloads · 30 days
9
2% of all-time downloads
vincentoh/llama3-alpaca-GGUF
llama3-alpaca-GGUF is a machine learning model from vincentoh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Meta's Llama-3 8B parameter base model trained on Alpaca dataset and outputed to 16bit GGUF Instruct model. Below is code for inference at command line using llama.cpp
Downloads · 30 days
9
2% of all-time downloads
All-time downloads
523
Public
Repo size
32.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf16.1 GB · 100%
From the Hugging Face model README
Meta's Llama-3 8B parameter base model trained on Alpaca dataset and outputed to 16bit GGUF Instruct model. Below is code for inference at command line using llama.cpp
./build/bin/main -m ./models/llama3_alpaca_dpo_GGUF-unsloth.F16.gguf \
-p '''Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.\n\n
### Instruction:\nWhy is the sky blue?\n\n
### Input:\n\n\n
### Response:\n'''