Downloads · 30 days
86
7% of all-time downloads
rustformers/pythia-ggml
pythia-ggml is a text generation model from rustformers. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
The Pythia Scaling Suite is a collection of models developed to facilitate interpretability research. It contains two sets of eight models of sizes 70M, 160M, 410M, 1B, 1.4B, 2.8B, 6.9B, and 12B. For each size, there…
Downloads · 30 days
86
7% of all-time downloads
All-time downloads
1.3K
Public
Repo size
44.7 GB
Likes
5
Public
Click a slice to open those files.
.bin27.1 GB · 100%
From the Hugging Face model README
The Pythia Scaling Suite is a collection of models developed to facilitate interpretability research. It contains two sets of eight models of sizes 70M, 160M, 410M, 1B, 1.4B, 2.8B, 6.9B, and 12B. For each size, there are two models: one trained on the Pile, and one trained on the Pile after the dataset has been globally deduplicated. All 8 model sizes are trained on the exact same data, in the exact same order. We also provide 154 intermediate checkpoints per model, hosted on Hugging Face as branches.
The Pythia model suite was deliberately designed to promote scientific research on large language models, especially interpretability research. Despite not centering downstream performance as a design goal, we find the models match or exceed the performance of similar and same-sized models, such as those in the OPT and GPT-Neo suites.
Via pip: pip install llm-rs
from llm_rs import AutoModel
#Load the model, define any model you like from the list above as the `model_file`
model = AutoModel.from_pretrained("rustformers/pythia-ggml",model_file="pythia-70m-q4_0-ggjt.bin")
#Generate
print(model.generate("The meaning of life is"))
git clone --recurse-submodules https://github.com/rustformers/llm.git
cd llm
cargo build --release
cargo run --release -- gptneox infer -m path/to/model.bin -p "Tell me how cool the Rust programming language is:"