t5-tiny-gec-hone

T5 Tiny GEC — Grammar Error Correction

Tiny grammar correction model exported to ONNX for Transformers.js v3. Based on visheratin/t5-efficient-tiny-grammar-correction.

• 4 decoder layers, d_model=256, num_heads=4
• Encoder: 43MB FP32 / 11MB INT8
• Decoder: 79MB FP32 / 20MB INT8
• Runs in-browser or Node.js via ONNX Runtime

Usage

import { pipeline } from '@huggingface/transformers';

const corrector = await pipeline('text2text-generation', 'rabden/t5-tiny-gec-hone', {
  quantized: true,
  dtype: 'q8',
});

const result = await corrector('he go to school yesterday', {
  max_new_tokens: 64,
  temperature: 0,
  do_sample: false,
});
// "He went to school yesterday."

Performance

Measured on CPU (Node.js, ONNX Runtime, INT8 quantized):

First-load from HuggingFace Hub: ~18s / Cached load: ~0.7s

Files

Notes

The ONNX export uses a custom NonGrowingCache for cross-attention to prevent KV cache doubling across decoder steps. Standard DynamicCache concatenates past and new encoder keys, causing a shape mismatch in cross-attention position bias on the second decoder step.