pythia-12b-4bit-uf-sft-tofu

Model Description

• Developed by: EleutherAI
• Model type: Transformer-based Language Model
• License: Apache 2.0
• Fine-tuned from: TOFU-SFT/pythia-12b-4bit

Bias, Risks, and Limitations

Warning: this model may produce harmful content

Citation

@misc{biderman2023pythiasuiteanalyzinglarge,
      title={Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling}, 
      author={Stella Biderman and Hailey Schoelkopf and Quentin Anthony and Herbie Bradley and Kyle O'Brien and Eric Hallahan and Mohammad Aflah Khan and Shivanshu Purohit and USVSN Sai Prashanth and Edward Raff and Aviya Skowron and Lintang Sutawika and Oskar van der Wal},
      year={2023},
      eprint={2304.01373},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2304.01373}, 
}