Downloads · 30 days
405
5% of all-time downloads
RichardErkhov/chargoddard_-_prometheus-2-llama-3-8b-gguf
chargoddard_-_prometheus-2-llama-3-8b-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
405
5% of all-time downloads
All-time downloads
8.7K
Public
Repo size
92.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf108 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
prometheus-2-llama-3-8b - GGUF
base_model:
Replication of prometheus-7b-v2.0 using Llama 3 8B Instruct as a base model.
As in their paper, two different models were trained on their preference and feedback datasets then linearly merged at equal weight.
Training hyperparameters:
Uses Llama 3 Instruct prompt format and the same prompts as prometheus-7b-v2.0. See that readme for info.
@misc{kim2023prometheus,
title={Prometheus: Inducing Fine-grained Evaluation Capability in Language Models},
author={Seungone Kim and Jamin Shin and Yejin Cho and Joel Jang and Shayne Longpre and Hwaran Lee and Sangdoo Yun and Seongjin Shin and Sungdong Kim and James Thorne and Minjoon Seo},
year={2023},
eprint={2310.08491},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
@misc{kim2024prometheus,
title={Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models},
author={Seungone Kim and Juyoung Suk and Shayne Longpre and Bill Yuchen Lin and Jamin Shin and Sean Welleck and Graham Neubig and Moontae Lee and Kyungjae Lee and Minjoon Seo},
year={2024},
eprint={2405.01535},
archivePrefix={arXiv},
primaryClass={cs.CL}
}