Downloads · 30 days
17
16% of all-time downloads
finance-slm-1m
sathishphdai/finance-slm-1m
finance-slm-1m is a text generation model from sathishphdai. Use it when you need the model to write or continue text. The card lists the license as mit.
A LLaMA-style transformer (~33.9M params) trained from scratch on Finance domain data. Supports up to 1M token context via RoPE.
All-time downloads
104
Public
Parameters
42.1M
608 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors168 MB · 55%
At a glance
- Task
- Text Generation
- License
- mit
- Model type
- finance-slm
- Access
- Public
- Created
- Mar 1, 2026
- Updated
- Mar 2, 2026
- SHA
- d75ecd93
Try a prompt
Model card
From the Hugging Face model README
Finance-SLM: Finance Small Language Model
A LLaMA-style transformer (~33.9M params) trained from scratch on Finance domain data. Supports up to 1M token context via RoPE.
Architecture
| Component | Value |
|---|---|
| Architecture | LLaMA-style (RoPE + RMSNorm + SwiGLU) |
| Parameters | ~33.9M |
| Layers | 8 |
| Heads | 8 |
| Embedding | 512 |
| Max Context | 100,000,000,000 tokens |
| Vocab | 16,000 BPE |
| Best Loss | 0.7834605552256108 |
License
MIT — Built from scratch.
- Task
- Text Generation
- Type
- finance-slm
- License
- mit
- Languages
- en
- Created
- Mar 1, 2026
- Updated
- Mar 2, 2026