Downloads · 30 days
9
0% of all-time downloads
Yosua69/blt-moe-distilled
blt-moe-distilled is a text generation model from Yosua69. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Byte Latent Transformer + MoE + 1-bit BitNet, distilled dari Qwen2.5-7B.
Downloads · 30 days
9
0% of all-time downloads
All-time downloads
3.1K
Public
Repo size
79.4 MB
Likes
0
Public
Click a slice to open those files.
.pth79.4 MB · 100%
From the Hugging Face model README
Byte Latent Transformer + MoE + 1-bit BitNet, distilled dari Qwen2.5-7B.
from huggingface_hub import hf_hub_download
exec(open(hf_hub_download("Yosua69/blt-moe-distilled", "inference.py")).read())
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
model = load_from_hub(device=device)
print(generate(model, device, prompt="The history of", max_bytes=150))