Downloads · 30 days
1
100% of all-time downloads
mxxsc/zip2zip-phi35-core-v1
zip2zip-phi35-core-v1 is a machine learning model from mxxsc. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for zip2zip.
Training checkpoint from zip2zip-core. This is a candidate model (not production-ready).
Downloads · 30 days
1
100% of all-time downloads
All-time downloads
1
Public
Repo size
50.2 GB
Likes
0
Public
Click a slice to open those files.
.pt18.7 GB · 100%
From the Hugging Face model README
Training checkpoint from zip2zip-core. This is a candidate model (not production-ready).
| Field | Value |
|---|---|
| model_config | Phi3.5-mini |
| init_from | microsoft/Phi-3.5-mini-instruct |
| max_subtokens | 4 |
| max_codebook_size | 2048 |
| seq_len | 2048 |
| lr | 0.0003 |
| max_tokens | 262144000 |
| step | 8000 |
| data | phi-1B-sft-8shards |
This is a training checkpoint (torchtitan format). To use for inference, export to HuggingFace format first:
python scripts/zip2zip_hf/export_to_zip2zip.py \
--ckpt_dir <local_path>/step_8000 \
--output_dir <export_dir> \
--base_model microsoft/Phi-3.5-mini-instruct \
--model_config Phi3.5-mini