Downloads · 30 days
1.2K
11% of all-time downloads
AlekseiPravdin/Hermes-2-Pro-Llama-3-8B-Llama3-8B-Chinese-Chat-slerp-merge-gguf
Hermes-2-Pro-Llama-3-8B-Llama3-8B-Chinese-Chat-slerp-merge-gguf is a machine learning model from AlekseiPravdin. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model has been quantized using llama-quantize from llama.cpp
Downloads · 30 days
1.2K
11% of all-time downloads
All-time downloads
10.6K
Public
Repo size
70.8 GB
Likes
1
Public
Click a slice to open those files.
.gguf70.8 GB · 100%
From the Hugging Face model README
This model has been quantized using llama-quantize from llama.cpp
Hermes-2-Pro-Llama-3-8B-Llama3-8B-Chinese-Chat-slerp-merge is a merge of the following models using mergekit:
slices:
- sources:
- model: NousResearch/Hermes-2-Pro-Llama-3-8B
layer_range: [0, 31]
- model: shenzhi-wang/Llama3-8B-Chinese-Chat
layer_range: [0, 31]
merge_method: slerp
base_model: NousResearch/Hermes-2-Pro-Llama-3-8B
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: float16
This fusion model combines the robust generative capabilities of NousResearch/Hermes-2-Pro-Llama-3-8B with the refined tuning of shenzhi-wang/Llama3-8B-Chinese-Chat, creating a versatile model suitable for a variety of text generation tasks. Leveraging the strengths of both parent models, Hermes-2-Pro-Llama-3-8B-Llama3-8B-Chinese-Chat-slerp-merge provides enhanced context understanding, nuanced text generation, and improved performance across diverse NLP tasks, including multilingual capabilities and structured outputs.
While the merged model inherits the strengths of both parent models, it may also carry over some limitations and biases. For instance, the model may exhibit inconsistencies in responses when handling complex queries or when generating content that requires deep contextual understanding. Additionally, the model's performance may vary based on the language used, with potential biases present in the training data affecting the quality of outputs in less represented languages or dialects. Users should remain aware of these limitations when deploying the model in real-world applications.