Downloads · 30 days
11
10% of all-time downloads
Mistral-7B-Instruct-v0.3-ha-function-calling-lora-Q8_0-GGUF
mkenfenheuer/Mistral-7B-Instruct-v0.3-ha-function-calling-lora-Q8_0-GGUF
Mistral-7B-Instruct-v0.3-ha-function-calling-lora-Q8_0-GGUF is a text generation model from mkenfenheuer. Use it when you need the model to write or continue text. It is set up for peft.
This LoRA adapter was converted to GGUF format from mkenfenheuer/Mistral-7B-Instruct-v0.3-ha-function-calling-lora via the ggml.ai's GGUF-my-lora space. Refer to the original adapter repository for more details.
All-time downloads
111
Public
Repo size
83.9 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf83.9 MB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- Access
- Public
- Created
- Oct 13, 2025
- Updated
- Oct 13, 2025
- SHA
- 470da1b6
Try a prompt
Base models
Model card
From the Hugging Face model README
mkenfenheuer/Mistral-7B-Instruct-v0.3-ha-function-calling-lora-Q8_0-GGUF
This LoRA adapter was converted to GGUF format from mkenfenheuer/Mistral-7B-Instruct-v0.3-ha-function-calling-lora via the ggml.ai's GGUF-my-lora space.
Refer to the original adapter repository for more details.
Use with llama.cpp
# with cli
llama-cli -m base_model.gguf --lora Mistral-7B-Instruct-v0.3-ha-function-calling-lora-q8_0.gguf (...other args)
# with server
llama-server -m base_model.gguf --lora Mistral-7B-Instruct-v0.3-ha-function-calling-lora-q8_0.gguf (...other args)
To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.
- Task
- Text Generation
- Library
- peft
- Created
- Oct 13, 2025
- Updated
- Oct 13, 2025