Downloads · 30 days
10
5% of all-time downloads
testsentry-llama-3b-F16-GGUF
joshjashp/testsentry-llama-3b-F16-GGUF
testsentry-llama-3b-F16-GGUF is a text generation model from joshjashp. Use it when you need the model to write or continue text. It is set up for peft.
This LoRA adapter was converted to GGUF format from joshjashp/testsentry-llama-3b via the ggml.ai's GGUF-my-lora space. Refer to the original adapter repository for more details.
All-time downloads
199
Public
Repo size
18.4 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf18.4 MB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- Access
- Public
- Created
- Jul 10, 2026
- Updated
- Jul 10, 2026
- SHA
- 4ffa2b9d
Try a prompt
Base models
Model card
From the Hugging Face model README
joshjashp/testsentry-llama-3b-F16-GGUF
This LoRA adapter was converted to GGUF format from joshjashp/testsentry-llama-3b via the ggml.ai's GGUF-my-lora space.
Refer to the original adapter repository for more details.
Use with llama.cpp
# with cli
llama-cli -m base_model.gguf --lora testsentry-llama-3b-f16.gguf (...other args)
# with server
llama-server -m base_model.gguf --lora testsentry-llama-3b-f16.gguf (...other args)
To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.
- Task
- Text Generation
- Library
- peft
- Created
- Jul 10, 2026
- Updated
- Jul 10, 2026