Downloads · 30 days
67
0% of all-time downloads
neuronovo-9B-v0.4
Neuronovo/neuronovo-9B-v0.4
neuronovo-9B-v0.4 is a text generation model from Neuronovo. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
More information about previous Neuronovo/neuronovo-9B-v0.2 version available here: 🔗Don't stop DPOptimizing!
All-time downloads
32.5K
Public
Parameters
9B
35.9 GB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors35.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Jan 16, 2024
- Updated
- Jan 16, 2024
- SHA
- f4bfa8b2
Try a prompt
Model card
From the Hugging Face model README
More information about previous Neuronovo/neuronovo-9B-v0.2 version available here: 🔗Don't stop DPOptimizing!
Author: Jan Kocoń 🔗LinkedIn 🔗Google Scholar 🔗ResearchGate
Changes concerning Neuronovo/neuronovo-9B-v0.2:
-
Training Dataset: In addition to the Intel/orca_dpo_pairs dataset, this version incorporates a mlabonne/chatml_dpo_pairs. The combined datasets enhance the model's capabilities in dialogues and interactive scenarios, further specializing it in natural language understanding and response generation.
-
Tokenizer and Formatting: The tokenizer now originates directly from the Neuronovo/neuronovo-9B-v0.2 model.
-
Training Configuration: The training approach has shifted from using
max_steps=200tonum_train_epochs=1. This represents a change in the training strategy, focusing on epoch-based training rather than a fixed number of steps. -
Learning Rate: The learning rate has been reduced to a smaller value of
5e-8. This finer learning rate allows for more precise adjustments during the training process, potentially leading to better model performance.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Languages
- en
- Created
- Jan 16, 2024
- Updated
- Jan 16, 2024