Downloads · 30 days
14
20% of all-time downloads
cm2435-new/laguna-xs2-dense-k8-recon-2k
laguna-xs2-dense-k8-recon-2k is a machine learning model from cm2435-new. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Research checkpoint from the Poolside Laguna XS.2 hackathon.
Downloads · 30 days
14
20% of all-time downloads
All-time downloads
70
Public
Parameters
3B
6 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors6 GB · 100%
From the Hugging Face model README
Research checkpoint from the Poolside Laguna XS.2 hackathon.
This model is a dense replacement experiment for poolside/Laguna-XS.2: each routed MoE MLP is replaced by a dense SwiGLU block with routed width 8 * expert_intermediate_size, while the shared expert path is kept. The checkpoint was initialized from cm2435-new/laguna-xs2-dense-k8-copied-shell and trained for 2,000 layer-wise reconstruction steps on nvidia/OpenCodeInstruct with sequence length 2048.
Important: this is not a usable coding model yet. It reloads, forwards, and generates, and reconstruction moved it from random-token output toward language-shaped output, but tiny coding smoke eval still fails functional tests. It is intended as a starting point for token-level SFT / KL distillation.
Tiny 5-prompt Python smoke eval on checkpoint-final:
poolside/Laguna-XS.2cm2435-new/laguna-xs2-dense-k8-copied-shellnvidia/OpenCodeInstructfrom transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained(
"cm2435-new/laguna-xs2-dense-k8-recon-2k",
trust_remote_code=True,
dtype="bfloat16",
device_map="auto",
)
tokenizer = AutoTokenizer.from_pretrained("poolside/Laguna-XS.2", trust_remote_code=True)