Downloads · 30 days
20
2% of all-time downloads
MN-12B-Lyra-v2a1
Sao10K/MN-12B-Lyra-v2a1
MN-12B-Lyra-v2a1 is a machine learning model from Sao10K. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
All-time downloads
841
Public
Parameters
12.2B
24.5 GB on disk
Likes
13
Public
Repo makeup
Click a slice to open those files.
.safetensors24.5 GB · 100%
At a glance
- License
- cc-by-nc-4.0
- Model type
- mistral
- Access
- Public
- Created
- Aug 12, 2024
- Updated
- Aug 13, 2024
- SHA
- 440fabbd
Model card
From the Hugging Face model README
Mistral Nemo 12B Lyra v2 - Stage 1
This is Stage 1 of Lyra v2. Only SFT and 2-Step Merge has been performed at this stage.
This is still raw, there may be issues.
Kinda wordy and verbose like Claude is, but that is fixable in stage 2, hopefully.
Stage 2 Plans - RL currently TBD
- [/INST] may leak, let's say that is an unintended side-effect. Just simply add it to your custom stopping strings. I tried adding it as an EOS in model config but that ruined the model somehow, so I didn't.
- min_p value of 0.1 is a sane value to use. Temp? 0.7-1.2, up to you.
- Prompt Format: ChatML
Have a day.
- Type
- mistral
- License
- cc-by-nc-4.0
- Languages
- en
- Created
- Aug 12, 2024
- Updated
- Aug 13, 2024