Downloads · 30 days
0
LocalAI-io/LocalAI-Llama3-8b-Function-Call-v0.2-GGUF
LocalAI-Llama3-8b-Function-Call-v0.2-GGUF is a machine learning model from LocalAI-io. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
0
Access
Public
Updated May 13, 2024
Repo size
61.5 GB
Likes
10
Public
Click a slice to open those files.
.bin61.5 GB · 100%
From the Hugging Face model README

This model is a fine-tune on a custom dataset + glaive to work specifically and leverage all the LocalAI features of constrained grammar.
Specifically, the model once enters in tools mode will always reply with JSON.
To run on LocalAI:
local-ai run huggingface://mudler/LocalAI-Llama3-8b-Function-Call-v0.2-GGUF/localai.yaml
If you like my work, consider up donating so can get resources for my fine-tunes!