Downloads · 30 days
6
6% of all-time downloads
pythia-12b-4bit
TOFU-SFT/pythia-12b-4bit
pythia-12b-4bit is a machine learning model from TOFU-SFT. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
- Developed by: EleutherAI - Model type: Transformer-based Language Model - License: Apache 2.0
All-time downloads
104
Public
Parameters
11.8B
6.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors6.5 GB · 100%
Parameter types
How the weights are stored.
U811.9B · 98%
Datasets
Model card
From the Hugging Face model README
Model Description
- Developed by: EleutherAI
- Model type: Transformer-based Language Model
- License: Apache 2.0
Bias, Risks, and Limitations
Warning: this model may produce harmful content
Citation
@misc{biderman2023pythiasuiteanalyzinglarge,
title={Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling},
author={Stella Biderman and Hailey Schoelkopf and Quentin Anthony and Herbie Bradley and Kyle O'Brien and Eric Hallahan and Mohammad Aflah Khan and Shivanshu Purohit and USVSN Sai Prashanth and Edward Raff and Aviya Skowron and Lintang Sutawika and Oskar van der Wal},
year={2023},
eprint={2304.01373},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2304.01373},
}
- Type
- gpt_neox
- License
- apache-2.0
- Languages
- en
- Created
- Apr 29, 2026
- Updated
- May 4, 2026