Downloads · 30 days
83
34% of all-time downloads
Sparse-AST-BWM-TopK-MoE
Chaman1234/Sparse-AST-BWM-TopK-MoE
Sparse-AST-BWM-TopK-MoE is a text generation model from Chaman1234. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Top-K Mixture-of-Experts (MoE) dynamic gating router connecting Sparse-AST expert backbones for specialized token-level routing on Blender 3D mathematics.
All-time downloads
241
Public
Parameters
37.3K
150 KB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors150 KB · 95%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- sparse_ast_moe
- Access
- Public
- Created
- Sep 8, 2026
- Updated
- Sep 8, 2026
- SHA
- e7e0ecf7
Try a prompt
Model card
From the Hugging Face model README
Sparse-AST-BWM-TopK-MoE
Top-K Mixture-of-Experts (MoE) dynamic gating router connecting Sparse-AST expert backbones for specialized token-level routing on Blender 3D mathematics.
Model Details
- Architecture: Sparse-AST (Top-K MoE Gating Router)
- Parameters: 33,605
- Serialization: SafeTensors (
model.safetensors) - Tied Embeddings: N/A
- Vocabulary: 512 (UTF-8 byte-level tokenization)
- Domain: Procedural 3D Mathematics, Blender Python (
bpy,mathutils,bmesh,numpy,gpu)
Experimentally Measured Benchmarks
Evaluated on the standardized Blender 3D Math & Python Curriculum suite:
| Metric | Measured Result |
|---|---|
| Curriculum Cross-Entropy Loss | 3.8544 |
| Perplexity | 47.20 |
| Evaluation Latency | 14.35s |
| Gating Mechanism | Top-2 Routing ($\tau = 1.0$) |
| Active Backbone Experts | 3M-32, 10M-32, 100M-32, 200M-32 |
Verification & Numerical Integrity
This SafeTensors distribution underwent full CPU verification against the original PyTorch checkpoint:
- Checked Tensors: 7
- Tied Weights Handled: 0
- Max Absolute Error:
0.0(Exact 0.0 bitwise equality) - Verification Status: PASS
Quick Start Inference
from model import TopKSparseASTEnsemble
router = TopKSparseASTEnsemble.from_pretrained('.')
- Task
- Text Generation
- Type
- sparse_ast_moe
- License
- apache-2.0
- Languages
- en, code
- Created
- Sep 8, 2026
- Updated
- Sep 8, 2026