Downloads · 30 days
0
SmolLM2-360M-webgpu
LJTSG/SmolLM2-360M-webgpu
SmolLM2-360M-webgpu is a text generation model from LJTSG. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
HuggingFace's tiny 360M parameter model running in browser WebGPU.
Access
Public
Updated Jun 3, 2026
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.html4.8 KB · 49%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Jun 3, 2026
- Updated
- Jun 3, 2026
- SHA
- a2728903
Try a prompt
Base models
Model card
From the Hugging Face model README
SmolLM2-360M on WebGPU
HuggingFace's tiny 360M parameter model running in browser WebGPU.
369 MB Q8_0 quantization. Loads in under 2 seconds. Generates instantly.
Built and tested on AMD Strix Halo (Radeon 8060S iGPU, 64GB unified memory).
Quick Start
- Download Q8_0 GGUF from bartowski
- Place in
model_splits/(no splitting needed — single file) node serve.js(port 8180)- Open
http://localhost:8180in Chrome
Use Cases
- Lightweight chat and Q&A
- Classification and summarization
- Edge/IoT inference
- Testing and prototyping
Hardware
Any WebGPU-capable device. Tested on AMD Strix Halo but works on much smaller hardware too. The model is only 369 MB — it fits anywhere.
Why This Package
Part of a series making popular models available on WebGPU for AMD unified memory AI PCs. WebGPU bypasses broken ROCm and routes through the gaming driver stack.
Credits
Built by Joshua (LJTSG) and Claude.
Co-Authored-By: Claude noreply@anthropic.com
- Task
- Text Generation
- License
- apache-2.0
- Created
- Jun 3, 2026
- Updated
- Jun 3, 2026