Downloads · 30 days
5
11% of all-time downloads
Jellon/Moonlight-L3-15B-v2.5-64k-exl2-4bpw
Moonlight-L3-15B-v2.5-64k-exl2-4bpw is a text generation model from Jellon. Use it when you need the model to write or continue text. It is set up for transformers.
4bpw exl2 quant of: https://huggingface.co/Darkknight535/Moonlight-L3-15B-v2.5-64k
Downloads · 30 days
5
11% of all-time downloads
All-time downloads
46
Public
Repo size
8.5 GB
Likes
0
Public
Click a slice to open those files.
.safetensors8.4 GB · 100%
From the Hugging Face model README
4bpw exl2 quant of: https://huggingface.co/Darkknight535/Moonlight-L3-15B-v2.5-64k
The model is a bit buggy and tends to runaway, I recommend you use:

Default llama3 instruct and context preset, but here is the one i use. Instruct Context
Temp : 1.2
Min P : 0.01
Repetition Penalty : 1.05
OR
Dry 0.7, 1.75, 2,0
XTC 0.1, 0.5
[And everything else neutral]
Temp : 0.6 - 0.8
Min P : 0.1
Repetition Penalty : 1.1
OR
Dry 1, 1.75, 2,0
XTC 0.1, 0.2
[And everything else neutral]
Develop the plot slowly, always stay in character. Describe all actions in full, elaborate, explicit, graphic, and vivid detail. Mention all relevant sensory perceptions. Keep the story immersive and engaging. Speak as other person when needed and prefix with the name of person you're speaking as except {{user}}.
This is a merge of pre-trained language models created using mergekit.
This model was merged using the SLERP merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: Darkknight535/Moonlight-L3-15B-v2-64k
layer_range: [0, 64]
- model: Tremontaine/L3-Lunaris-v1-15B
layer_range: [0, 64]
merge_method: slerp
base_model: Darkknight535/Moonlight-L3-15B-v2-64k
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5 # fallback for rest of tensors
dtype: bfloat16