Hermes-2-Pro-Mistral-7B-infinity-GGUF

Hermes 2 Pro Mistral-7B Infinity-Instruct GGUF

This model is a fine-tuned version of NousResearch/Hermes-2-Pro-Mistral-7B on the BAAI/Infinity-Instruct dataset. You can find the main model page here.

Model Details

• Base Model: NousResearch/Hermes-2-Pro-Mistral-7B
• Dataset: BAAI/Infinity-Instruct
• Sequence Length: 8192 tokens
• Training:
• Epochs: 1
• Hardware: 4 Nodes x 4 NVIDIA A100 40GB GPUs
• Duration: 26:56:43
• Cluster: KIT SCC Cluster

Benchmark n_shots=0

For detailed benchmark results, including sub-categories and various metrics, please refer to the full benchmark table at the end of this README.

License

This model is released under the Apache 2.0 license.

chatml

<|im_start|>system
{system_prompt}<|im_end|>
<|im_start|>user
Knock Knock, who is there?<|im_end|>
<|im_start|>assistant
Hi there! <|im_end|>

Acknowledgements

Special thanks to:

• NousResearch for their excellent base model
• BAAI for providing the Infinity-Instruct dataset
• KIT SCC for FLOPS

Citation

If you use this model in your research, consider citing. Although definetly cite NousResearch and BAAI:

@misc{hermes2pro-mistral-7b-infinity,
  author = {juvi21},
  title = {Hermes 2 Pro Mistral-7B Infinity-Instruct},
  year = {2024},
}

full-benchmark-results