Downloads · 30 days
7
19% of all-time downloads
Shivik-1B-MEGA
navflyer/Shivik-1B-MEGA
Shivik-1B-MEGA is a machine learning model from navflyer. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Ultimate merged model combining 2 unique Shivik-1B variants.
All-time downloads
37
Public
Parameters
1.2B
2.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.5 GB · 100%
At a glance
- Model type
- shivik_m4
- Access
- Public
- Created
- Jan 2, 2026
- Updated
- Jan 2, 2026
- SHA
- ced3bfca
Model card
From the Hugging Face model README
Shivik-1B-MEGA
Description
Ultimate merged model combining 2 unique Shivik-1B variants.
Merged Models
- Final-Ready
- MERGED
Architecture
- Parameters: ~1.24B
- Hidden size: 2048
- Layers: 16
- Attention heads: 32
- KV heads: 8 (GQA 4:1)
- Vocab size: 128,262
Special Tokens
<think>/</think>- Chain-of-thought reasoning<step>/</step>- Step-by-step problem solving<answer>/</answer>- Final answers
Note
Models excluded from merge (incompatible architecture):
- Teacher-Enhanced: 1.24B, norm=torch.Size([3072])
- Trained-Merged: 1.50B, norm=torch.Size([2048])
- Type
- shivik_m4
- Created
- Jan 2, 2026
- Updated
- Jan 2, 2026