Downloads · 30 days
13
18% of all-time downloads
ettin-encoder-32m-arxiv-classification-512
vumichien/ettin-encoder-32m-arxiv-classification-512
ettin-encoder-32m-arxiv-classification-512 is a text classification model from vumichien. Use it when you need a label for a piece of text. The card lists the license as mit.
jhu-clsp/ettin-encoder-32m (ModernBERT encoder, 8192 context) finetuned for arXiv paper topic classification (11 classes), 512-token context (ablation baseline) on ccdv/arxiv-classification.
All-time downloads
73
Public
Parameters
32M
128 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors128 MB · 97%
At a glance
- Task
- Text Classification
- License
- mit
- Model type
- modernbert
- Access
- Public
- Created
- Jun 9, 2026
- Updated
- Jun 9, 2026
- SHA
- 7972e7d9
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
ettin-encoder-32m-arxiv-classification-512
jhu-clsp/ettin-encoder-32m (ModernBERT encoder, 8192 context) finetuned for arXiv paper topic classification (11 classes), 512-token context (ablation baseline) on ccdv/arxiv-classification.
Results (held-out test)
| metric | value |
|---|---|
| accuracy | 0.774 |
| macro-F1 | 0.7692 |
| eval max_length | 512 |
Finetuned on a single RTX 3080 (bf16). See the project for the full training pipeline.
Usage
from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch
tok = AutoTokenizer.from_pretrained("vumichien/ettin-encoder-32m-arxiv-classification-512")
model = AutoModelForSequenceClassification.from_pretrained("vumichien/ettin-encoder-32m-arxiv-classification-512")
inputs = tok("your text here", truncation=True, max_length=512, return_tensors="pt")
pred = model(**inputs).logits.argmax(-1).item()
print(model.config.id2label[pred])
- Task
- Text Classification
- Type
- modernbert
- License
- mit
- Languages
- en
- Created
- Jun 9, 2026
- Updated
- Jun 9, 2026