Downloads · 30 days
11
16% of all-time downloads
lora-Q8_0-GGUF
artem12323452/lora-Q8_0-GGUF
lora-Q8_0-GGUF is a text generation model from artem12323452. Use it when you need the model to write or continue text. It is set up for peft.
This LoRA adapter was converted to GGUF format from artem12323452/lora via the ggml.ai's GGUF-my-lora space. Refer to the original adapter repository for more details.
All-time downloads
70
Public
Repo size
63.8 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf63.8 MB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- Access
- Public
- Created
- Mar 26, 2026
- Updated
- Mar 26, 2026
- SHA
- 7e8cd418
Try a prompt
Base models
Model card
From the Hugging Face model README
artem12323452/lora-Q8_0-GGUF
This LoRA adapter was converted to GGUF format from artem12323452/lora via the ggml.ai's GGUF-my-lora space.
Refer to the original adapter repository for more details.
Use with llama.cpp
# with cli
llama-cli -m base_model.gguf --lora lora-q8_0.gguf (...other args)
# with server
llama-server -m base_model.gguf --lora lora-q8_0.gguf (...other args)
To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.
- Task
- Text Generation
- Library
- peft
- Created
- Mar 26, 2026
- Updated
- Mar 26, 2026