WestSeverus-7B-DPO-v2

WestSeverus - 7B - DPO - v2

☘️ Model Description

WestSeverus-7B-DPO-v2 is a WestLake Family model trained over WestSeverus-7B.

The model was trained on several dpo datasets and it can perform well on basic math problem.

WestSeverus-7B-DPO-v2 can be used in mathematics, chemical, physics and even coding for further research and reference.

📖 Table of Contents

1. Nous Benchmark Results

   • AGIEval
   • GPT4All
   • TruthfulQA Scores
   • BigBench

2. Open LLM Leaderboard

   • ARC
   • HellaSwag
   • MMLU
   • TruthfulQA
   • Winogrande
   • GSM8K

3. EvalPlus Leaderboard

   • HumanEval
   • HumanEval_Plus
   • MBPP
   • MBPP_Plus

4. Prompt Format

5. Quantized Models

6. Gratitude

🪄 Nous Benchmark Results

WestSeverus-7B-DPO-v2 is currently on the top of the YALL - Yet Another LLM Leaderboard created by CultriX and it outperforms on TruthfulQA Scores and BigBench.

🏆 Open LLM Leaderboard

WestSeverus-7B-DPO-v2 is one of the top 7B model in Open LLM Leaderboard and it outperforms on TruthfulQA and GSM8K.

Detailed results can be found here

⚡ EvalPlus Leaderboard

⚗️ Prompt Format

WestSeverus-7B-DPO-v2 was trained using the ChatML prompt templates with system prompts. An example follows below:

<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

🛠️ Quantized Models

Another version of WestSeverus Model:

• PetroGPT/WestSeverus-7B-DPO

• GGUF: https://huggingface.co/TheBloke/WestSeverus-7B-DPO-GGUF

• GGUF: https://huggingface.co/s3nh/WestSeverus-7B-DPO-GGUF

• GPTQ: https://huggingface.co/TheBloke/WestSeverus-7B-DPO-GPTQ

• AWQ: https://huggingface.co/TheBloke/WestSeverus-7B-DPO-AWQ

MaziyarPanahi/WestSeverus-7B-DPO-v2-GGUF

• GGUF: https://huggingface.co/MaziyarPanahi/WestSeverus-7B-DPO-v2-GGUF

🙏 Gratitude

• Thanks to @senseable for senseable/WestLake-7B-v2.
• Thanks to @jondurbin for jondurbin/truthy-dpo-v0.1 dataset.
• Thanks to @Charles Goddard for MergeKit.
• Thanks to @TheBloke, @s3nh, @MaziyarPanahi for Quantized Models.
• Thanks to @mlabonne, @CultriX for YALL - Yet Another LLM Leaderboard.
• Thank you to all the other people in the Open Source AI community who utilized this model for further research and improvement.