Downloads · 30 days
8
3% of all-time downloads
pythia-160m-shuffle-dyck-500steps
michahu8/pythia-160m-shuffle-dyck-500steps
pythia-160m-shuffle-dyck-500steps is a feature extraction model from michahu8. Use it when you need embeddings to search or compare text. It is set up for transformers.
See https://github.com/michahu/pre-pretraining for more information.
All-time downloads
255
Public
Parameters
124M
495 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors495 MB · 100%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- gpt_neox
- Access
- Public
- Created
- Oct 13, 2025
- Updated
- Oct 13, 2025
- SHA
- 96b24f9e
Model card
From the Hugging Face model README
See https://github.com/michahu/pre-pretraining for more information.
Usage:
model = AutoModel.from_pretrained('michahu8/pythia-160m-shuffle-dyck-500steps')
tokenizer = AutoTokenizer.from_pretrained('EleutherAI/pythia-160m')
- Task
- Feature Extraction
- Library
- transformers
- Type
- gpt_neox
- Created
- Oct 13, 2025
- Updated
- Oct 13, 2025