Themis-7b

ernie-research/Themis-7b

Themis-7b is a machine learning model from ernie-research. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.

<a href="https://iclr.cc/Conferences/2024" target="blank" <img alt="ICLR 2024" src="https://img.shields.io/badge/Proceedings-ICLR2024-red" / </a

Downloads · 30 days

4% of all-time downloads

All-time downloads

253

Public

Repo size

27 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin27 GB · 100%

At a glance

Library: transformers
License: mit
Model type: llama
Access: Public
Created: Feb 9, 2024
Updated: Jun 6, 2025
SHA: 4d8ac301

Datasets

ernie-research/TARA

Model card

From the Hugging Face model README

Offical checkpoint for Tool-Augmented Reward Modeling (ICLR 2024 spotlight).

Model Description

Themis is a tool-augmented preference model to address these limitations by empowering RMs with access to external environments, including calculators and search engines. It was introduced in the ICLR 2024 paper and first released in this repository. Themis-7b is trained with TARA, achieving a noteworthy overall improvement of 17.7% across eight tasks in preference ranking.

🔥 News

9 February, 2024: 🎉 We release the official codebase and model weights of ernie-research/Themis-7b. Stay tuned!🔥
16 January, 2024: 🎉 Our work has been accepted to ICLR 2024 spotlight! ✨

Citation

@inproceedings{tarm-2024-ernie,
  author = {Lei Li and
            Yekun Chai and
            Shuohuan Wang and
            Yu Sun and
            Hao Tian and
            Ningyu Zhang and
            Hua Wu},
  title = {Tool-Augmented Reward Modeling},
  booktitle = {The Twelfth International Conference on Learning Representations (ICLR)},
  year = {2024},
  url = {https://openreview.net/forum?id=d94x0gWTUX},
}

Library: transformers
Type: llama
License: mit
Languages: en
Created: Feb 9, 2024
Updated: Jun 6, 2025