Downloads · 30 days
4
1% of all-time downloads
zephyr-7b-beta-lora-F16-GGUF
leon9851/zephyr-7b-beta-lora-F16-GGUF
zephyr-7b-beta-lora-F16-GGUF is a text generation model from leon9851. Use it when you need the model to write or continue text. It is set up for peft.
This LoRA adapter was converted to GGUF format from typeof/zephyr-7b-beta-lora via the ggml.ai's GGUF-my-lora space. Refer to the original adapter repository for more details.
All-time downloads
383
Public
Repo size
671 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf671 MB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- Access
- Public
- Created
- Mar 24, 2025
- Updated
- Mar 24, 2025
- SHA
- 0c421432
Try a prompt
Base models
Model card
From the Hugging Face model README
leon9851/zephyr-7b-beta-lora-F16-GGUF
This LoRA adapter was converted to GGUF format from typeof/zephyr-7b-beta-lora via the ggml.ai's GGUF-my-lora space.
Refer to the original adapter repository for more details.
Use with llama.cpp
# with cli
llama-cli -m base_model.gguf --lora zephyr-7b-beta-lora-f16.gguf (...other args)
# with server
llama-server -m base_model.gguf --lora zephyr-7b-beta-lora-f16.gguf (...other args)
To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.
- Task
- Text Generation
- Library
- peft
- Languages
- en
- Created
- Mar 24, 2025
- Updated
- Mar 24, 2025