Downloads · 30 days
0
gemma-3-4b-it-vindex
cronos3k/gemma-3-4b-it-vindex
gemma-3-4b-it-vindex is a machine learning model from cronos3k. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Decomposed weights for google/gemma-3-4b-it in LarQL vindex format.
Access
Public
Updated Apr 16, 2026
Repo size
7.8 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin7.8 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 16, 2026
- Updated
- Apr 16, 2026
- SHA
- 584e8dfb
Base models
Model card
From the Hugging Face model README
Gemma 3 4B Instruct — Vindex Format
Decomposed weights for google/gemma-3-4b-it in LarQL vindex format.
Use with vindex-infer for vendor-free LLM inference — no CUDA, no PyTorch, just a Rust binary.
Quick Start
# Download
huggingface-cli download cronos3k/gemma-3-4b-it-vindex --local-dir gemma3-4b.vindex
# Run inference (CPU — works on any machine)
vindex-infer --vindex gemma3-4b.vindex --token-ids "818,5279,529,7001,563"
# 1. Paris (+21.24)
# 2. a (+17.69)
# 3. the (+17.51)
Files
| File | Size | Contents |
|---|---|---|
| gate_vectors.bin | 1.66 GB | FFN gate projections [34 layers × 10240 × 2560] f16 |
| up_weights.bin | 1.66 GB | FFN up projections [34 × 10240 × 2560] f16 |
| down_weights.bin | 1.66 GB | FFN down projections [34 × 2560 × 10240] f16 |
| attn_weights.bin | 1.02 GB | Q/K/V/O + QK norms per layer, f16 |
| embeddings.bin | 1.25 GB | Token embeddings [262208 × 2560] f16 |
| norms.bin | 0.7 MB | RMSNorm gammas (4 per layer + final) f16 |
| tokenizer.json | 32 MB | HuggingFace tokenizer |
| index.json | 5 KB | Model config, layer info |
| Total | 7.29 GB |
Extraction
Extracted using LarQL with --level all --f16:
larql extract-index google/gemma-3-4b-it -o gemma3-4b.vindex --level all --f16
Verification
Output matches HuggingFace Transformers to 5 significant figures across all 34 layers. Residual norms track exactly: Layer 34 = 67806.5 (HF: 67806).
Verified prompts: Paris, Jupiter, blue, Ulm, Pound — all correct.
Credits
- Model: Google Gemma 3
- Decomposition: LarQL by Chris Hayuk
- Inference: vindex-infer
- License
- apache-2.0
- Created
- Apr 16, 2026
- Updated
- Apr 16, 2026