Downloads · 30 days
30
27% of all-time downloads
Wiola360M
oscowlai/Wiola360M
Wiola360M is a text generation model from oscowlai. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Wiola-360M is a 360 million parameter decoder-only language model developed by OSCOWL AI.
All-time downloads
113
Public
Parameters
318M
1.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- wiola
- Access
- Public
- Created
- Jul 27, 2026
- Updated
- Jul 27, 2026
- SHA
- 2db32a16
Try a prompt
Model card
From the Hugging Face model README
Wiola-360M
Wiola-360M is a 360 million parameter decoder-only language model developed by OSCOWL AI.
Architecture
Wiola introduces several architectural improvements over a standard Transformer decoder:
- Grouped Query Attention (GQA)
- Spiral Rotary Positional Encoding (SRPE)
- Adaptive Token Merging (ATM)
- Gated Cross Layer Attention (GCLA)
- Dual Stream Feed Forward (DSFF)
Model
- Parameters: 360M
- Context Length: 2048
- Vocabulary Size: 32000
- Attention Heads: 16
- Key/Value Heads: 4
Usage
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained(
"oscowlai/Wiola360M",
trust_remote_code=True,
)
model = AutoModelForCausalLM.from_pretrained(
"oscowlai/Wiola360M",
trust_remote_code=True,
)
License
Apache-2.0
- Task
- Text Generation
- Library
- transformers
- Type
- wiola
- License
- apache-2.0
- Languages
- en
- Created
- Jul 27, 2026
- Updated
- Jul 27, 2026