Downloads · 30 days
24
20% of all-time downloads
cybersecurity-slm-1m
sathishphdai/cybersecurity-slm-1m
cybersecurity-slm-1m is a text generation model from sathishphdai. Use it when you need the model to write or continue text. The card lists the license as mit.
A LLaMA-style transformer (~33.9M params) trained from scratch on Cybersecurity domain data. Supports up to 1M token context via RoPE.
All-time downloads
120
Public
Parameters
42.1M
608 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors168 MB · 55%
At a glance
- Task
- Text Generation
- License
- mit
- Model type
- cybersecurity-slm
- Access
- Public
- Created
- Mar 1, 2026
- Updated
- Mar 2, 2026
- SHA
- 16b24d80
Try a prompt
Model card
From the Hugging Face model README
Cybersecurity-SLM: Cybersecurity Small Language Model
A LLaMA-style transformer (~33.9M params) trained from scratch on Cybersecurity domain data. Supports up to 1M token context via RoPE.
Architecture
| Component | Value |
|---|---|
| Architecture | LLaMA-style (RoPE + RMSNorm + SwiGLU) |
| Parameters | ~33.9M |
| Layers | 8 |
| Heads | 8 |
| Embedding | 512 |
| Max Context | 100,000,000,000 tokens |
| Vocab | 16,000 BPE |
| Best Loss | 0.9175312474370003 |
License
MIT — Built from scratch.
- Task
- Text Generation
- Type
- cybersecurity-slm
- License
- mit
- Languages
- en
- Created
- Mar 1, 2026
- Updated
- Mar 2, 2026