Downloads · 30 days
0
shauryakochar/anlp-a1-c5
anlp-a1-c5 is a machine learning model from shauryakochar. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Encoder-decoder Transformer built from basic PyTorch operations (no nn.Transformer, nn.MultiheadAttention or nn.LayerNorm), trained to map encrypted binary sequences to plaintext.
Downloads · 30 days
0
Access
Public
Updated Sep 2, 2026
Repo size
36.7 MB
Likes
0
Public
Click a slice to open those files.
.pt36.7 MB · 100%
From the Hugging Face model README
Encoder-decoder Transformer built from basic PyTorch operations (no nn.Transformer,
nn.MultiheadAttention or nn.LayerNorm), trained to map encrypted binary sequences to
plaintext.
C5 - Byte Latent Transformer (token-free)
{
"config": "C5",
"params": 9091587,
"train_time_s": 3541.51580119133,
"sec_per_epoch": 50.59308287416186,
"test_bit_accuracy": 1.0,
"test_char_accuracy": 1.0,
"test_sequence_accuracy": 1.0,
"test_levenshtein": 0.0,
"test_levenshtein_norm": 0.0,
"peak_mem_mb": 817.107968
}
C5.pt - model weights, config and training argumentsCode: https://github.com/shaurya-kochar/anlp-assignment1 WandB: https://wandb.ai/shaurya-kochar-iiit-hyderabad/anlp-a1-transformer-ablation