Downloads · 30 days
15
8% of all-time downloads
DarwinAnim8or/QwenLawdMoE-F16-GGUF
QwenLawdMoE-F16-GGUF is a machine learning model from DarwinAnim8or. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
Trained for 2 epochs on restraint training, just a test run. Feel free to use it if you want, if you get anything fun let me know in the community tab
Downloads · 30 days
15
8% of all-time downloads
All-time downloads
189
Public
Repo size
27.5 MB
Likes
0
Public
Click a slice to open those files.
.gguf27.5 MB · 100%
From the Hugging Face model README
Trained for 2 epochs on restraint training, just a test run. Feel free to use it if you want, if you get anything fun let me know in the community tab
This LoRA adapter was converted to GGUF format from DarwinAnim8or/QwenLawdMoE via the ggml.ai's GGUF-my-lora space.
Refer to the original adapter repository for more details.
# with cli
llama-cli -m base_model.gguf --lora QwenLawdMoE-f16.gguf (...other args)
# with server
llama-server -m base_model.gguf --lora QwenLawdMoE-f16.gguf (...other args)
To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.