Downloads · 30 days
19
23% of all-time downloads
ettin-encoder-32m-arxiv-classification-8192
vumichien/ettin-encoder-32m-arxiv-classification-8192
ettin-encoder-32m-arxiv-classification-8192 is a text classification model from vumichien. Use it when you need a label for a piece of text. The card lists the license as mit.
jhu-clsp/ettin-encoder-32m (ModernBERT encoder, 8192 context) finetuned for arXiv paper topic classification (11 classes), 8192-token context on ccdv/arxiv-classification.
All-time downloads
84
Public
Parameters
32M
128 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors128 MB · 97%
At a glance
- Task
- Text Classification
- License
- mit
- Model type
- modernbert
- Access
- Public
- Created
- Jun 9, 2026
- Updated
- Jun 9, 2026
- SHA
- bbe527e2
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
ettin-encoder-32m-arxiv-classification-8192
jhu-clsp/ettin-encoder-32m (ModernBERT encoder, 8192 context) finetuned for arXiv paper topic classification (11 classes), 8192-token context on ccdv/arxiv-classification.
Results (held-out test)
| metric | value |
|---|---|
| accuracy | 0.783 |
| macro-F1 | 0.7803 |
| eval max_length | 8192 |
Finetuned on a single RTX 3080 (bf16). See the project for the full training pipeline.
Usage
from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch
tok = AutoTokenizer.from_pretrained("vumichien/ettin-encoder-32m-arxiv-classification-8192")
model = AutoModelForSequenceClassification.from_pretrained("vumichien/ettin-encoder-32m-arxiv-classification-8192")
inputs = tok("your text here", truncation=True, max_length=8192, return_tensors="pt")
pred = model(**inputs).logits.argmax(-1).item()
print(model.config.id2label[pred])
- Task
- Text Classification
- Type
- modernbert
- License
- mit
- Languages
- en
- Created
- Jun 9, 2026
- Updated
- Jun 9, 2026