Downloads · 30 days
0
financial-language-model
Nikilesh9/financial-language-model
financial-language-model is a machine learning model from Nikilesh9. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Custom-trained Transformer for financial text generation.
Access
Public
Updated Nov 23, 2025
Repo size
4.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pkl4.2 GB · 95%
At a glance
- License
- mit
- Access
- Public
- Created
- Nov 21, 2025
- Updated
- Nov 23, 2025
- SHA
- 66662fbf
Model card
From the Hugging Face model README
Financial Language Model
Custom-trained Transformer for financial text generation.
Model Details
- Architecture: 6-layer Transformer
- Parameters: ~12M
- Vocabulary: 20,000 words
- Training Data: 1 GB balanced financial corpus (168M words)
- Validation Loss: 4.01
- Modern Content: 87%
Training Data Composition
- Financial news (2015-2024): 750 MB (87%)
- Classical economics: 35 MB (4%)
- Wikipedia/Academic: 15 MB (2%)
Usage
from huggingface_hub import hf_hub_download
import torch
import pickle
# Download files
model_path = hf_hub_download(repo_id="Nikilesh9/financial-language-model", filename="transformer_1gb_balanced_best.pth")
dataset_path = hf_hub_download(repo_id="Nikilesh9/financial-language-model", filename="mega_word_dataset.pkl")
# Load dataset
with open(dataset_path, 'rb') as f:
dataset = pickle.load(f)
# Load model
checkpoint = torch.load(model_path, map_location='cpu')
# ... create and load model ...
Files
transformer_1gb_balanced_best.pth- Model checkpoint (50 MB)mega_word_dataset.pkl- Preprocessed dataset (2.2 GB)
Training Details
- Hardware: Google Colab TPU v2
- Training Time: 7.5 hours
- Epochs: 30
- Batch Size: 512
- Learning Rate: 0.0003 (adaptive)
Project
Full project: https://github.com/Nikilesh9/language-model-evolution
- License
- mit
- Languages
- en
- Created
- Nov 21, 2025
- Updated
- Nov 23, 2025