Downloads · 30 days
10
34% of all-time downloads
MN-12B-Lyra-v2a1
Darok/MN-12B-Lyra-v2a1
MN-12B-Lyra-v2a1 is a machine learning model from Darok. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
All-time downloads
29
Public
Parameters
12.2B
24.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors24.5 GB · 100%
At a glance
- License
- cc-by-nc-4.0
- Model type
- mistral
- Access
- Public
- Created
- Sep 16, 2024
- Updated
- Sep 16, 2024
- SHA
- b9643d04
Model card
From the Hugging Face model README
Mistral Nemo 12B Lyra v2 - Stage 1
This is Stage 1 of Lyra v2. Only SFT and 2-Step Merge has been performed at this stage.
This is still raw, there may be issues.
Kinda wordy and verbose like Claude is, but that is fixable in stage 2, hopefully.
Stage 2 Plans - RL currently TBD
- [/INST] may leak, let's say that is an unintended side-effect. Just simply add it to your custom stopping strings. I tried adding it as an EOS in model config but that ruined the model somehow, so I didn't.
- min_p value of 0.1 is a sane value to use. Temp? 0.7-1.2, up to you.
- Prompt Format: ChatML
Have a day.
- Type
- mistral
- License
- cc-by-nc-4.0
- Languages
- en
- Created
- Sep 16, 2024
- Updated
- Sep 16, 2024