Downloads · 30 days
46
3% of all-time downloads
santacoder-code-to-text
loubnabnl/santacoder-code-to-text
santacoder-code-to-text is a text generation model from loubnabnl. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as openrail.
This model is a fine-tuned version of bigcode/santacoder on copdeparrot/gitub-jupyter-code-to-text.
All-time downloads
1.7K
Public
Repo size
9.2 GB
Likes
5
Public
Repo makeup
Click a slice to open those files.
.bin4.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- openrail
- Model type
- gpt2
- Access
- Public
- Created
- Jan 24, 2023
- Updated
- Feb 2, 2023
- SHA
- 6d71f0b7
Try a prompt
Model card
From the Hugging Face model README
Santacoder code-to-text
This model is a fine-tuned version of bigcode/santacoder on copdeparrot/gitub-jupyter-code-to-text.
Training procedure
The model was trained on 4 A100 for 3h with the following hyperparameters were used during training on 4 A100:
- learning_rate: 5e-05
- train_batch_size: 2
- eval_batch_size: 2
- seed: 42
- gradient_accumulation_steps: 4
- total_train_batch_size: 4
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- lr_scheduler_warmup_steps: 100
- training_steps: 800
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- openrail
- Created
- Jan 24, 2023
- Updated
- Feb 2, 2023