Downloads · 30 days
27
7% of all-time downloads
LocalAI-io/LocalAI-Llama3-8b-Function-Call-v0.2
LocalAI-Llama3-8b-Function-Call-v0.2 is a text generation model from LocalAI-io. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
Downloads · 30 days
27
7% of all-time downloads
All-time downloads
377
Public
Parameters
8B
16.1 GB on disk
Likes
10
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
NEW!!!
Check the latest model series: https://huggingface.co/mudler/LocalAI-functioncall-phi-4-v0.3

OpenVINO: https://huggingface.co/fakezeta/LocalAI-Llama3-8b-Function-Call-v0.2-ov-int8
GGUF: https://huggingface.co/mudler/LocalAI-Llama3-8b-Function-Call-v0.2-GGUF
This model is a fine-tune on a custom dataset + glaive to work specifically and leverage all the LocalAI features of constrained grammar.
Specifically, the model once enters in tools mode will always reply with JSON.
To run on LocalAI:
local-ai run huggingface://mudler/LocalAI-Llama3-8b-Function-Call-v0.2-GGUF/localai.yaml
If you like my work, consider up donating so can get resources for my fine-tunes!