Downloads · 30 days
0
shauryakochar/anlp-a1-c2
anlp-a1-c2 is a machine learning model from shauryakochar. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Encoder-decoder Transformer built from basic PyTorch operations (no nn.Transformer, nn.MultiheadAttention or nn.LayerNorm), trained to map encrypted binary sequences to plaintext.
Downloads · 30 days
0
Access
Public
Updated Sep 2, 2026
Repo size
31.3 MB
Likes
0
Public
Click a slice to open those files.
.pt31.3 MB · 100%
From the Hugging Face model README
Encoder-decoder Transformer built from basic PyTorch operations (no nn.Transformer,
nn.MultiheadAttention or nn.LayerNorm), trained to map encrypted binary sequences to
plaintext.
C2 - RoPE positional encoding
{
"config": "C2",
"params": 7767552,
"train_time_s": 3017.6436553001404,
"sec_per_epoch": 43.10919507571629,
"test_bit_accuracy": 0.9953438231705534,
"test_char_accuracy": 0.9881507384777714,
"test_sequence_accuracy": 0.9319062181447503,
"test_levenshtein": 0.11192660550458716,
"test_levenshtein_norm": 0.0018428136979128204,
"test_bleu": 0.9846447220102763,
"test_rouge_l": 0.9920164845050211,
"peak_mem_mb": 1334.543872
}
C2.pt - model weights, config and training argumentsCode: https://github.com/shaurya-kochar/anlp-assignment1 WandB: https://wandb.ai/shaurya-kochar-iiit-hyderabad/anlp-a1-transformer-ablation