Downloads · 30 days
11
14% of all-time downloads
ChesterProgrammer/CPT-Lucy-V0
CPT-Lucy-V0 is a image-text-to-text model from ChesterProgrammer. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
- Method Continued pretraining - Epochs 3 - Batch size 4 - Grad Accum 2 - Learning rate 0.00005 - Embedding Learning Rate 0.000005 - Optimizer AdamW 8-bit - Context length 2048 - Warmup steps 4 - Packing True - weight…
Downloads · 30 days
11
14% of all-time downloads
All-time downloads
81
Public
Parameters
9.4B
37.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors18.8 GB · 100%
How the weights are stored.
BF169.4B · 100%
From the Hugging Face model README
Method Continued pretraining
Epochs 3
Batch size 4
Grad Accum 2
Learning rate 0.00005
Embedding Learning Rate 0.000005
Optimizer AdamW 8-bit
Context length 2048
Warmup steps 4
Packing True
weight decay 0.001
LR scheduler Cosine
seed 3407
LoRA Rank 32
Alpha 64
Dropout 0.0
Variant RS-lora
Dataset 2-Pass CPT Corpus
This qwen3_5 model was trained 2x faster with Unsloth and Huggingface's TRL library.