2024101030-anlp-assignment1

astroduck17/2024101030-anlp-assignment1

2024101030-anlp-assignment1 is a machine learning model from astroduck17. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch. The card lists the license as other.

Student: Yashav Bhatnagar Roll number: 2024101030

Downloads · 30 days

Access

Public

Updated Sep 3, 2026

Repo size

159 MB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pt159 MB · 100%

At a glance

Library: pytorch
License: other
Access: Public
Created: Sep 3, 2026
Updated: Sep 3, 2026
SHA: 2b122bce

Model card

From the Hugging Face model README

ANLP Assignment 1: Transformers from Scratch

Student: Yashav Bhatnagar
Roll number: 2024101030

This repository contains the trained checkpoints and preprocessing states for the five configurations used in ANLP Assignment 1.

Config	Main setting
C1	Sinusoidal positions, MHA, LayerNorm, learned BPE
C2	RoPE, MHA, LayerNorm, learned BPE
C3	Sinusoidal positions, GQA, LayerNorm, learned BPE
C4	Sinusoidal positions, MHA, RMSNorm, learned BPE
C5	Sinusoidal positions, MHA, LayerNorm, entropy-based byte patches

Repository contents

C1/model.pt through C4/model.pt: best tokenized-model checkpoints
C1/src_tokenizer.pkl through C4/src_tokenizer.pkl: source BPE states
C1/tgt_tokenizer.pkl through C4/tgt_tokenizer.pkl: target BPE states
C5/model.pt: best C5 checkpoint
C5/patcher_state.json: fitted source and target entropy-patcher state

The models and BPE tokenizers were implemented from scratch in PyTorch for the course assignment. C5 groups every eight cipher bits into one byte before applying entropy-based dynamic patching.

Library: pytorch
License: other
Created: Sep 3, 2026
Updated: Sep 3, 2026