Downloads · 30 days
25
13% of all-time downloads
FinGPT-131M
Tharun007/FinGPT-131M
FinGPT-131M is a machine learning model from Tharun007. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
FinGPT-131M is a 131M-parameter decoder-only language model trained from scratch on a GST/tax regulatory corpus.
All-time downloads
194
Public
Parameters
131M
1.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors526 MB · 99%
At a glance
- Model type
- fingpt
- Access
- Public
- Created
- Aug 18, 2026
- Updated
- Sep 1, 2026
- SHA
- 7b37f936
Model card
From the Hugging Face model README
FinGPT-131M
FinGPT-131M is a 131M-parameter decoder-only language model trained from scratch on a GST/tax regulatory corpus.
Architecture
- Parameters: ~131.3M
- Layers: 13
- Hidden size: 768
- Attention heads: 12
- Context length: 1024
- Vocabulary: 50,257
- Tokenizer: GPT-2 BPE
- Activation: GELU
- Attention: causal scaled dot-product attention
- Weight tying: Yes
Training
Best checkpoint:
- Step: 11,250
- Validation loss: 2.7641
The model was trained from scratch; it is not fine-tuned from GPT-2.
Intended use
The model is intended for experimentation and research on language modeling over GST and tax-related text.
Limitations
This model should not be treated as a source of authoritative legal or tax advice. Tax regulations can change, and model outputs may contain hallucinations or outdated information.
- Type
- fingpt
- Created
- Aug 18, 2026
- Updated
- Sep 1, 2026