Downloads · 30 days
0
anlp-a1-transformer-ablations
leviathanWakes/anlp-a1-transformer-ablations
anlp-a1-transformer-ablations is a translation model from leviathanWakes. Use it when you need text moved from one language to another. The card lists the license as mit.
This repository contains the trained weights for a sequence-to-sequence translation task using various custom-built Transformer architectures from scratch.
Access
Public
Updated Sep 3, 2026
Repo size
1.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt1.1 GB · 100%
At a glance
- Task
- Translation
- License
- mit
- Access
- Public
- Created
- Sep 2, 2026
- Updated
- Sep 3, 2026
- SHA
- 904919aa
Try a prompt
Model card
From the Hugging Face model README
ANLP Assignment 1: Transformer Ablations
This repository contains the trained weights for a sequence-to-sequence translation task using various custom-built Transformer architectures from scratch.
Checkpoints Included
C1_baseline/best.pt: Baseline Transformer (Sinusoidal PE, MHA, LayerNorm)C2_rope/best.pt: Rotary Positional Encoding (RoPE)C3_gqa/best.pt: Grouped-Query Attention (GQA)C4_rmsnorm/best.pt: RMSNorm
Tokenizers
The shared BPE tokenizers used to encode the sequence data are included in the root directory:
src_tokenizer.jsontgt_tokenizer.json
Author: Rachit Mehta (2024101089)
- Task
- Translation
- License
- mit
- Languages
- en
- Created
- Sep 2, 2026
- Updated
- Sep 3, 2026