Downloads · 30 days
5
7% of all-time downloads
neural-history-chat-v1.5
ambrosfitz/neural-history-chat-v1.5
neural-history-chat-v1.5 is a text generation model from ambrosfitz. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc.
An updated version of Neural History Chat, using the mighty-history-merge dataset to fine-tune the previous version (v1.0).
All-time downloads
76
Public
Parameters
7.2B
14.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc
- Model type
- mistral
- Access
- Public
- Created
- Jan 25, 2024
- Updated
- Jan 26, 2024
- SHA
- 63d02738
Try a prompt
Model card
From the Hugging Face model README
Model Card for Model ID
An updated version of Neural History Chat, using the mighty-history-merge dataset to fine-tune the previous version (v1.0).
Model Details
Run history:
train/epoch ▁▁▂▂▃▃▃▄▄▅▅▅▆▆▇▇▇██
train/global_step ▁▁▂▂▃▃▃▄▄▅▅▅▆▆▇▇▇██
train/learning_rate ▂▃▅▆▇█▇▇▆▆▅▄▄▃▃▂▂▁
train/loss █▆▄▃▃▃▃▃▂▃▂▂▁▁▁▁▂▁
train/total_flos ▁
train/train_loss ▁
train/train_runtime ▁
train/train_samples_per_second ▁
train/train_steps_per_second ▁
Run summary:
train/epoch 1.98
train/global_step 92
train/learning_rate 0.0
train/loss 0.7792
train/total_flos 1.756453697101824e+16
train/train_loss 1.30356
train/train_runtime 1176.2194
train/train_samples_per_second 10.068
train/train_steps_per_second 0.078
Training Explained
We went with a shorter training session of roughly 2 epochs for testing and evaluation. More steps/epochs might be in the future, but colab pricing is pretty steep. Currently to merge the peft back to the model, requires roughly 40GB of GPU RAM. So renting a Google Colab A100 is required and runs through credits quickly.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- cc
- Created
- Jan 25, 2024
- Updated
- Jan 26, 2024