Downloads · 30 days
144
5% of all-time downloads
RichardErkhov/M4-ai_-_Hercules-5.0-Qwen2-1.5B-gguf
M4-ai_-_Hercules-5.0-Qwen2-1.5B-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
144
5% of all-time downloads
All-time downloads
3K
Public
Repo size
18.6 GB
Likes
0
Public
Click a slice to open those files.
.gguf21.5 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Hercules-5.0-Qwen2-1.5B - GGUF
license: apache-2.0 datasets:
We fine-tuned qwen2-1.5B on a high quality mix for general-purpose assistants. A DPO version of this will be released soon. We use the ChatML prompt format.
This model has capabilities in math, coding, writing, and more. We fine-tuned it using a high quality mix for general-purpose assistants.
General purpose assistant, question answering, chain-of-thought, etc..
This language model made an impressive achievement, and correctly implemented a Multi Head Attention for use in a transformer neural network.
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
coming soon
We used 8 Kaggle TPUs, and we trained at a global batch size of 256 and sequence length of 1536.