Downloads · 30 days
19
1% of all-time downloads
Goekdeniz-Guelmez/J.O.S.I.E.v4o-8b-stage1-beta1
J.O.S.I.E.v4o-8b-stage1-beta1 is a text generation model from Goekdeniz-Guelmez. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model will be used for the base model in J.O.S.I.E.v4o and furhter trained.
Downloads · 30 days
19
1% of all-time downloads
All-time downloads
2.1K
Public
Parameters
8B
48.2 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
This model will be used for the base model in J.O.S.I.E.v4o and furhter trained.
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
"per_device_train_batch_size": 2,
"gradient_accumulation_steps": 8,
"max_steps": 300,
"learning_rate": 2e-4,
"optim": "adamw_8bit",
"weight_decay": 0.01,
"lr_scheduler_type": "cosine"
"""<|begin_of_text|>system
You are J.O.S.I.E. which is an acronym for "Just an Outstandingly Smart Intelligent Entity", a private and super-intelligent AI assistant, created by Gökdeniz Gülmez.<|end_of_text|>
<|begin_of_text|>main user "Gökdeniz Gülmez"
{{ .Prompt }}<|end_of_text|>
<|begin_of_text|>josie
{{ .Response }}<|end_of_text|>"""