Downloads · 30 days
0
anlp-assignment1-c1-byte8-optimized
Anivarth/anlp-assignment1-c1-byte8-optimized
anlp-assignment1-c1-byte8-optimized is a machine learning model from Anivarth. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Custom encoder-decoder Transformer using sinusoidal positions, multi-head attention, pre-LayerNorm and from-scratch byte-level BPE subword tokenization.
Access
Public
Updated Aug 30, 2026
Repo size
145 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt145 MB · 98%
At a glance
- Access
- Public
- Created
- Aug 30, 2026
- Updated
- Aug 30, 2026
- SHA
- b601bbe6
Model card
From the Hugging Face model README
ANLP Assignment 1 - C1 baseline
Custom encoder-decoder Transformer using sinusoidal positions, multi-head attention, pre-LayerNorm and from-scratch byte-level BPE subword tokenization.
Greedy test metrics
- bit_accuracy: 0.596782
- sequence_accuracy: 0.000000
- levenshtein_distance: 469.238000
- bleu: 0.568477
- rouge1: 0.185158
- rouge2: 0.025190
- rougeL: 0.146625
- parameters: 11841512.000000
- best_validation_loss: 2.559813
Load best_model.pt with the architecture and tokenizers from this assignment code.
- Created
- Aug 30, 2026
- Updated
- Aug 30, 2026