Downloads · 30 days
12
35% of all-time downloads
camembert-finetune-Jul-Song
kykyDeBondy/camembert-finetune-Jul-Song
camembert-finetune-Jul-Song is a fill-mask model from kykyDeBondy. Use it when you need the model to fill a missing word. It is set up for transformers.
The model is a mask model, who has been trained on Jul (french rapper) lyrics.
All-time downloads
34
Public
Parameters
111M
443 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors443 MB · 99%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- Model type
- camembert
- Access
- Public
- Created
- Nov 8, 2025
- Updated
- Nov 8, 2025
- SHA
- 325893bb
Try a prompt
Model card
From the Hugging Face model README
Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->The model is a mask model, who has been trained on Jul (french rapper) lyrics.
Model Details
It is a fintuning version of the almanach/camembert-base model.
Training Details
Training Data
The training data is the lyrics of Jul song, you can find it here kykyDeBondy/camembert-finetune-Jul-Song.
Training Procedure
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->Preprocessing [optional]
[More Information Needed]
Training Hyperparameters
- Training regime: eval_strategy="steps", eval_steps=1000, learning_rate=2e-5, weight_decay=0.01, fp16=True,
Speeds, Sizes, Times [optional]
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->[More Information Needed]
Evaluation
Perplexity (before training): 13.26 Perplexity (after training): 5.74
| Step | Training Loss | Validation Loss | Model Preparation Time |
|---|---|---|---|
| 1000 | 1.972400 | 1.844505 | 0.002800 |
| 2000 | 1.842100 | 1.733608 | 0.002800 |
- Task
- Fill-Mask
- Library
- transformers
- Type
- camembert
- Created
- Nov 8, 2025
- Updated
- Nov 8, 2025