Downloads · 30 days
0
Nekochu/Luminia-13B-v4-QLora
Luminia-13B-v4-QLora is a machine learning model from Nekochu. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Downloads · 30 days
0
Access
Public
Updated May 7, 2024
Repo size
2.1 GB
Likes
0
Public
Click a slice to open those files.
.pt1 GB · 49%
From the Hugging Face model README
Training resume from Luminia-13B-v3.
<!-- [05/24] This should include all dataset from LLaMA-Factory, and more.-->Luminia-13B-v4-QLora-sft (rank 32) barelly can handle new Luminia-mixture and ExtendedPrompts should give more flexible when ask prompt, e.g.:
### Instruction:
Create stable diffusion prompt based on the given english description.
### Input:
City street, night, raining, drone shot, cyberpunk
### Response:
And so Stage-B DPO: I do NOT recommend use QLora-orpo, poor lora failed to learn more . :<