Downloads · 30 days
0
anlp-a1-c2
SinisterLlama/anlp-a1-c2
anlp-a1-c2 is a machine learning model from SinisterLlama. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
This model is part of the ANLP Assignment 1: Custom Transformers & Byte Latent Transformers at IIIT Hyderabad.
Access
Public
Updated Sep 3, 2026
Repo size
140 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt140 MB · 100%
At a glance
- Library
- transformers
- License
- mit
- Access
- Public
- Created
- Sep 3, 2026
- Updated
- Sep 3, 2026
- SHA
- 9bd04fda
Model card
From the Hugging Face model README
Config 2: Pre-LN Subword Transformer
This model is part of the ANLP Assignment 1: Custom Transformers & Byte Latent Transformers at IIIT Hyderabad.
Architecture
- Description: Encoder-Decoder Seq2Seq Transformer, Pre-LayerNorm architecture for improved gradient flow, Sinusoidal PE, MHA.
- Parameters: 11.67M
Test Evaluation Results
- Bit-Level Accuracy: 93.63%
- Sequence Accuracy: 67.74%
- BLEU Score: 98.86%
- ROUGE-1 / ROUGE-2 / ROUGE-L: 99.28% / 98.12% / 99.28%
- Average Levenshtein Distance: 0.40
Repository & Links
- GitHub: https://github.com/SinisterLlamma/ANLP-Assignment1
- Author: Eshaan Sharma (SinisterLlama)
- Library
- transformers
- License
- mit
- Languages
- en
- Created
- Sep 3, 2026
- Updated
- Sep 3, 2026