Downloads · 30 days
0
candidate-Llaza-MS2-flat-20BT
epfl-dlab/candidate-Llaza-MS2-flat-20BT
candidate-Llaza-MS2-flat-20BT is a machine learning model from epfl-dlab. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for zip2zip.
Training checkpoint from zip2zip-core. This is a candidate model (not production-ready).
Access
Public
Updated May 16, 2026
Repo size
15.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt12.4 GB · 100%
At a glance
- Library
- zip2zip
- Access
- Public
- Created
- May 16, 2026
- Updated
- May 16, 2026
- SHA
- f37b02c5
Model card
From the Hugging Face model README
candidate-Llaza-MS2-flat-20BT
Training checkpoint from zip2zip-core. This is a candidate model (not production-ready).
Training Config
| Field | Value |
|---|---|
| model_config | 1B |
| init_from | scratch |
| max_subtokens | 2 |
| max_codebook_size | 4096 |
| seq_len | 4096 |
| lr | 0.0003 |
| max_tokens | 20000000000 |
| step | 19074 |
| data | llaza-20B-tokens-128shards |
Usage
This is a training checkpoint (torchtitan format). To use for inference, export to HuggingFace format first:
python scripts/zip2zip_hf/export_to_zip2zip.py \
--ckpt_dir <local_path>/step_19074 \
--output_dir <export_dir> \
--base_model scratch \
--model_config 1B
- Library
- zip2zip
- Created
- May 16, 2026
- Updated
- May 16, 2026