laya-gguf

Laya — GGUF

GGUF version of convaiinnovations/laya, packaged for the laya-rust inference engine.

Laya is a non-autoregressive System One decision model: 421M parameters, a ModernBERT-large encoder plus a decision head. Give it a state (text, email, ticket, JSON) and typed questions; it returns typed answers with probabilities in a single forward pass. It never generates text.

Files

Both hold the same values — the published checkpoint is F16, and the F32 file is a lossless widening of it — and they return identical answers. Each file is self-contained (weights, architecture, tokenizer, fitted calibration temperatures), so no sidecar files are needed.

Run it with laya-rust

git clone https://github.com/zerodegress/laya-rust && cd laya-rust
cargo build --release --no-default-features --features mlx     # Apple Silicon; cuda is the default feature

./target/release/laya test -m /path/to/laya-f16.gguf - < request.json

This is not a llama.cpp GGUF: the architecture is laya, which llama.cpp does not know.

Attribution

Weights: Convai Innovations and Laya contributors, Apache-2.0 — see convaiinnovations/laya. Converted with the engine's own laya convert, and verified tensor by tensor against the published checkpoint.