Downloads · 30 days
21
29% of all-time downloads
cloud-architect-slm-1m
sathishphdai/cloud-architect-slm-1m
cloud-architect-slm-1m is a text generation model from sathishphdai. Use it when you need the model to write or continue text. The card lists the license as mit.
A LLaMA-style transformer (~1018.2M params, ~1.02B) trained from scratch for the Cloud Architect role. Supports up to 1M token context via RoPE with gradient checkpointing.
All-time downloads
72
Public
Parameters
1B
8.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.2 GB · 51%
At a glance
- Task
- Text Generation
- License
- mit
- Model type
- cloud_architect-slm
- Access
- Public
- Created
- Mar 4, 2026
- Updated
- Mar 5, 2026
- SHA
- 0fc9a3cb
Try a prompt
Model card
From the Hugging Face model README
Cloud Architect-SLM: Role-Based Small Language Model
A LLaMA-style transformer (~1018.2M params, ~1.02B) trained from scratch for the Cloud Architect role. Supports up to 1M token context via RoPE with gradient checkpointing.
Architecture
| Component | Value |
|---|---|
| Architecture | LLaMA-style (RoPE + RMSNorm + SwiGLU) |
| Parameters | ~1018.2M (~1.02B) |
| Layers | 32 |
| Heads | 20 |
| Embedding | 1600 |
| Max Context | 100,000,000,000 tokens |
| Max Output | 1,000,000 tokens |
| Vocab | 19,845 BPE |
| Model Size | ~4 GB (fp32) |
Training
- Best eval loss: 5.727677822113037
- Trained with gradient checkpointing on Apple M4 (MPS)
- 3 epochs, batch_size=1, grad_accum=16
Usage
from huggingface_hub import hf_hub_download
from tokenizers import Tokenizer
model_path = hf_hub_download("sathishphdai/cloud-architect-slm-1m", "model.safetensors")
tokenizer_path = hf_hub_download("sathishphdai/cloud-architect-slm-1m", "cloud_architect_tokenizer.json")
tokenizer = Tokenizer.from_file(tokenizer_path)
- Task
- Text Generation
- Type
- cloud_architect-slm
- License
- mit
- Languages
- en
- Created
- Mar 4, 2026
- Updated
- Mar 5, 2026