Downloads · 30 days
310
78% of all-time downloads
cicero
gaodrew/cicero
cicero is a text generation model from gaodrew. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Pretrained from scratch using GPT-2 architecture and a dataset of Latin texts (Corpus Corporum) 64 token context, loss 4.5, trained on 1 epoch of 492 million tokens GPT2 style tokenizer trained with minfrequency of 2000
All-time downloads
398
Public
Parameters
99.3M
5.6 GB on disk
Likes
2
Trending 1
Repo makeup
Click a slice to open those files.
.safetensors397 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- gpt2
- Access
- Public
- Created
- Jun 17, 2024
- Updated
- Jun 18, 2024
- SHA
- 5ac7f224
Model card
From the Hugging Face model README
Pretrained from scratch using GPT-2 architecture and a dataset of Latin texts (Corpus Corporum) 64 token context, loss 4.5, trained on 1 epoch of 492 million tokens GPT2 style tokenizer trained with min_frequency of 2000
Tends to get repetitive and is not very coherent, due to size and limited data.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- apache-2.0
- Languages
- la
- Created
- Jun 17, 2024
- Updated
- Jun 18, 2024