Downloads · 30 days
0
shauryakochar/anlp-a1-c3
anlp-a1-c3 is a machine learning model from shauryakochar. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Encoder-decoder Transformer built from basic PyTorch operations (no nn.Transformer, nn.MultiheadAttention or nn.LayerNorm), trained to map encrypted binary sequences to plaintext.
Downloads · 30 days
0
Access
Public
Updated Sep 2, 2026
Repo size
27.4 MB
Likes
0
Public
Click a slice to open those files.
.pt27.4 MB · 100%
From the Hugging Face model README
Encoder-decoder Transformer built from basic PyTorch operations (no nn.Transformer,
nn.MultiheadAttention or nn.LayerNorm), trained to map encrypted binary sequences to
plaintext.
C3 - Grouped-Query Attention
{
"config": "C3",
"params": 6583296,
"train_time_s": 3288.3812091350555,
"sec_per_epoch": 46.97687441621508,
"test_bit_accuracy": 0.991681403344119,
"test_char_accuracy": 0.9792019805100988,
"test_sequence_accuracy": 0.9076452599388379,
"test_levenshtein": 0.1577981651376147,
"test_levenshtein_norm": 0.0025980652134508617,
"test_bleu": 0.9794481544905806,
"test_rouge_l": 0.9888820909927502,
"peak_mem_mb": 1317.060096
}
C3.pt - model weights, config and training argumentsCode: https://github.com/shaurya-kochar/anlp-assignment1 WandB: https://wandb.ai/shaurya-kochar-iiit-hyderabad/anlp-a1-transformer-ablation