Downloads · 30 days
4
100% of all-time downloads
epfl-dlab/zip2zip-pp-Phi-3.5-mini-instruct
zip2zip-pp-Phi-3.5-mini-instruct is a text generation model from epfl-dlab. Use it when you need the model to write or continue text. It is set up for zip2zip. The card lists the license as mit.
Zip2Zip++ checkpoint based on microsoft/Phi-3.5-mini-instruct (training step 8000). The repository keeps the original training checkpoint on main and the user-facing, self-contained inference export on hf.
Downloads · 30 days
4
100% of all-time downloads
All-time downloads
4
Public
Repo size
25.9 GB
Likes
0
Public
Click a slice to open those files.
.pt17.3 GB · 100%
From the Hugging Face model README
Zip2Zip++ checkpoint based on microsoft/Phi-3.5-mini-instruct (training step
8000). The repository keeps the original training checkpoint on main and
the user-facing, self-contained inference export on hf.
pip install "zip2zip>=0.2.0"
from zip2zip import Zip2ZipModel, Zip2ZipTokenizer
repo_id = "epfl-dlab/zip2zip-pp-Phi-3.5-mini-instruct"
tokenizer = Zip2ZipTokenizer.from_pretrained(
repo_id, revision="hf"
)
model = Zip2ZipModel.from_pretrained(
repo_id, revision="hf", device_map="auto", dtype="auto"
)
inputs = tokenizer("Hello", return_tensors="pt").to(model.device)
output = model.generate(**inputs, max_new_tokens=100)
print(tokenizer.decode(output[0], skip_special_tokens=True))
Use main only with zip2zip-plus-plus
when resuming training or reproducing the export. It is not a Transformers/zip2zip inference revision.