Downloads · 30 days
68
0% of all-time downloads
BruinsV2-OpHermesNeu-11B
Ba2han/BruinsV2-OpHermesNeu-11B
BruinsV2-OpHermesNeu-11B is a text generation model from Ba2han. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Warning! This model may or may not be contaminated See discussion 474. What a shame. It still does perform well though
All-time downloads
37.3K
Public
Parameters
10.7B
23 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors21.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- mistral
- Access
- Public
- Created
- Dec 11, 2023
- Updated
- Dec 19, 2023
- SHA
- a9f7d839
Try a prompt
Model card
From the Hugging Face model README
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| arc_challenge | 0 | acc | 0.6527 | ± | 0.0139 |
| acc_norm | 0.6869 | ± | 0.0136 |
Warning! This model may or may not be contaminated See discussion 474. What a shame. It still does perform well though
A passthrough merge of OpenHermes-2.5-neural-chat-7b-v3-1 and Bruins-V2. To be updated.
Template: ChatML
My settings:
Temperature: 0.7-0.8
Min_p: 0.12
Top_K: 0
Repetition Penalty: 1.16
Mirostat Tau: 2.5-3
Mirostat Eta: 0.12
Personal Thoughts:
- The model sometimes throws wrong tags, you can add those to "Custom stopping strings" in Oobabooga.
- Output with Mirostat consistently felt smarter than a set Top_K rate.
Note: The model is hallucinating hard in chat mode for me in some instances, like writing adblocker messages. Kind of funny.
I am not sure which dataset involved was poisoned.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- mit
- Created
- Dec 11, 2023
- Updated
- Dec 19, 2023