Downloads · 30 days
24
6% of all-time downloads
DA-BPE-CEREBRAS
RyeAI/DA-BPE-CEREBRAS
DA-BPE-CEREBRAS is a text generation model from RyeAI. Use it when you need the model to write or continue text. It is set up for transformers.
This CerebrasGPT-111M model employs a standard Byte-Pair-Encoding (BPE) tokenizer for Danish text. It serves as a benchmark to compare against morphology-aware tokenizers.
All-time downloads
374
Public
Parameters
111M
222 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors222 MB · 98%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Nov 21, 2024
- Updated
- Dec 28, 2024
- SHA
- c5efc0e7
Try a prompt
Model card
From the Hugging Face model README
DA-BPE-CEREBRAS
This CerebrasGPT-111M model employs a standard Byte-Pair-Encoding (BPE) tokenizer for Danish text. It serves as a benchmark to compare against morphology-aware tokenizers.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- Created
- Nov 21, 2024
- Updated
- Dec 28, 2024