Downloads · 30 days
10
31% of all-time downloads
akshayballal/grug-modernbert-meetingbank
grug-modernbert-meetingbank is a token classification model from akshayballal. Use it when you need labels on individual words, such as names. It is set up for transformers. The card lists the license as cc-by-nc-sa-4.0.
Binary preserve/discard token classifier for prompt compression, trained with grug train on microsoft/MeetingBank-LLMCompressed.
Downloads · 30 days
10
31% of all-time downloads
All-time downloads
32
Public
Parameters
150M
598 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors598 MB · 99%
From the Hugging Face model README
Binary preserve/discard token classifier for prompt compression, trained with
grug train on microsoft/MeetingBank-LLMCompressed.
import grug
from grug.backends.modern import ModernBackend
comp = grug.Compressor(ModernBackend(model_name='akshayballal/grug-modernbert-meetingbank'))
result = comp.compress(text, rate=0.4)
{
"model_name": "answerdotai/ModernBERT-base",
"epochs": 10,
"learning_rate": 1e-05,
"batch_size": 16,
"max_length": 512,
"weight_decay": 0.01,
"warmup_ratio": 0.06,
"device": "cuda",
"seed": 0,
"push_to": "akshayballal/grug-modernbert-meetingbank",
"cs_weight": 0.0
}
{
"epoch": 10,
"train_loss": 0.27965768989389395,
"val_loss": 0.35605784938448953,
"val_accuracy": 0.845020038796005,
"val_precision": 0.7942048472217553,
"val_recall": 0.7886062175819921,
"val_f1": 0.7913956308240605,
"val_perplexity": 1.4276901368706316
}
The training corpus is CC-BY-NC-SA-4.0, so this model inherits a non-commercial constraint.