Downloads · 30 days
13
19% of all-time downloads
epfl-ml-ytf/apertus-8b-pruned-english-ds-63159
apertus-8b-pruned-english-ds-63159 is a machine learning model from epfl-ml-ytf. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model is a vocabulary-pruned English-only version of swiss-ai/Apertus-8B-Instruct-2509. It was created as part of an academic project in Machine Learning to investigate the effects of vocabulary reduction on mode…
Downloads · 30 days
13
19% of all-time downloads
All-time downloads
69
Public
Parameters
7.5B
30 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors30 GB · 100%
How the weights are stored.
F327.5B · 100%
From the Hugging Face model README
This model is a vocabulary-pruned English-only version of swiss-ai/Apertus-8B-Instruct-2509. It was created as part of an academic project in Machine Learning to investigate the effects of vocabulary reduction on model size and performance.
Base Model: Apertus-8B-Instruct-2509
Developer (Base Model): Swiss AI Initiative (ETH Zurich, EPFL, CSCS)
Pruning Method: Vocabulary Pruning (see details below)
The pruned vocabulary was obtained by collecting all the tokens found in a dataset purely in english. We used the following dataset: B. Consortium, “British national corpus 1994,” 2007, literary and Linguistic Data Service.
This model is intended for academic research and educational purposes, specifically to study:
For general-purpose instruction following or production use, we recommend using the original swiss-ai/Apertus-8B-Instruct-2509.
You can load this model using the transformers library. Ensure you are using a recent version of transformers.
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
model_id = "epfl-ml-ytf/apertus-8b-pruned-english-ds-63159"
# Load the pruned tokenizer and model
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.bfloat16,
device_map="auto"
)
# Example generation
messages = [
{"role": "user", "content": "Explain the concept of vocabulary pruning in one sentence."}
]
inputs = tokenizer.apply_chat_template(messages, return_tensors="pt", add_generation_prompt=True).to(model.device)
outputs = model.generate(inputs, max_new_tokens=100)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))