Downloads · 30 days
5
2% of all-time downloads
Mostafa8Mehrabi/llama-1b-3blocks-BI-pruned-KD-bookcorpus-improved_epoch_10
llama-1b-3blocks-BI-pruned-KD-bookcorpus-improved_epoch_10 is a text generation model from Mostafa8Mehrabi. Use it when you need the model to write or continue text. It is set up for transformers.
This is a knowledge-distilled version of Llama-1B using improved token chunking approach.
Downloads · 30 days
5
2% of all-time downloads
All-time downloads
219
Public
Parameters
1.1B
2.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.1 GB · 99%
From the Hugging Face model README
This is a knowledge-distilled version of Llama-1B using improved token chunking approach.
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("Mostafa8Mehrabi/llama-1b-3blocks-BI-pruned-KD-bookcorpus-improved_epoch_10")
model = AutoModelForCausalLM.from_pretrained("Mostafa8Mehrabi/llama-1b-3blocks-BI-pruned-KD-bookcorpus-improved_epoch_10")