Downloads · 30 days
16
7% of all-time downloads
LoneStriker/SciPhi-Mistral-7B-32k-5.0bpw-h6-exl2
SciPhi-Mistral-7B-32k-5.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
16
7% of all-time downloads
All-time downloads
230
Public
Repo size
4.7 GB
Likes
0
Public
Click a slice to open those files.
.safetensors4.7 GB · 100%
From the Hugging Face model README
License: llama2
The SciPhi-Mistral-7B-32k is a Large Language Model (LLM) fine-tuned from Mistral-7B-v0.1. This model underwent a fine-tuning process over four epochs using more than 1 billion tokens, which include regular instruction tuning data and synthetic textbooks. The objective of this work was to increase the model's scientific reasoning and educational abilities.
Base Model: Mistral-7B-v0.1
Architecture Features:
Thank you to the AI Alignment Lab, vikp, jph00 and others who contributed to this work.