Downloads · 30 days
15
28% of all-time downloads
ERAV4-Week13-SmolLLM2-135m
Sunny063/ERAV4-Week13-SmolLLM2-135m
ERAV4-Week13-SmolLLM2-135m is a text generation model from Sunny063. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This repository contains a SmolLM2-135M compatible checkpoint trained from scratch as part of ERA V4 Week13.
All-time downloads
53
Public
Parameters
163M
326 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors326 MB · 99%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jan 3, 2026
- Updated
- Jan 3, 2026
- SHA
- a2e57f4a
Try a prompt
Model card
From the Hugging Face model README
SmolLM2-135M (ERA V4 Week13) — trained from scratch
This repository contains a SmolLM2-135M compatible checkpoint trained from scratch as part of ERA V4 Week13.
Architecture (exported)
- vocab_size=49152
- hidden_size=576
- intermediate_size=1536
- num_layers=30
- n_heads=9
- n_kv_heads=3
- RoPE theta=100000.0
- RMSNorm eps=1e-05
- max_position_embeddings=8192
- tie_word_embeddings=True
Quick usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "<YOUR_HF_USERNAME/YOUR_MODEL_REPO>"
tok = AutoTokenizer.from_pretrained(model_id, use_fast=True)
model = AutoModelForCausalLM.from_pretrained(model_id)
inputs = tok("BIANCA:", return_tensors="pt")
out = model.generate(**inputs, max_new_tokens=80)
print(tok.decode(out[0], skip_special_tokens=True))
- Task
- Text Generation
- Type
- llama
- License
- apache-2.0
- Created
- Jan 3, 2026
- Updated
- Jan 3, 2026