Downloads · 30 days
11
12% of all-time downloads
Nepal_legalGPT2_Scratch
chhatramani/Nepal_legalGPT2_Scratch
Nepal_legalGPT2_Scratch is a text generation model from chhatramani. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This is a custom GPT-2 style transformer model trained from scratch on Nepal's legal documents. The model was implemented entirely in PyTorch without relying on pre-trained weights, specifically designed to understand…
All-time downloads
92
Public
Repo size
240 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin120 MB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- gpt2
- Access
- Public
- Created
- Aug 11, 2025
- Updated
- Aug 11, 2025
- SHA
- 28b84c85
Try a prompt
Model card
From the Hugging Face model README
Nepal Legal GPT-2 (From Scratch Implementation)
This is a custom GPT-2 style transformer model trained from scratch on Nepal's legal documents. The model was implemented entirely in PyTorch without relying on pre-trained weights, specifically designed to understand and generate text related to Nepal's legal domain.
Model Details
- Model Architecture: GPT-2 style Transformer
- Parameters: ~1 million
- Context Length: 128 tokens
- Layers: 6
- Attention Heads: 6
- Embedding Dimension: 384
- Vocabulary Size: 50,257 (GPT-2 tokenizer)
- Training Data: Nepal Legal QA English Dataset
- License: MIT
Training Data Experimental
The model was trained on a specialized dataset of Nepal's legal documents in English, containing:
- Legal questions and answers
- Procedural instructions
- Legal definitions and explanations
- Court procedures and regulations
- Task
- Text Generation
- Type
- gpt2
- License
- apache-2.0
- Languages
- en
- Created
- Aug 11, 2025
- Updated
- Aug 11, 2025