Downloads · 30 days
1
6% of all-time downloads
adamo1139/Mistral-7B-Magpie-Ultra-GaLore-0711
Mistral-7B-Magpie-Ultra-GaLore-0711 is a machine learning model from adamo1139. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
1
6% of all-time downloads
All-time downloads
18
Public
Parameters
7.2B
14.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors14.5 GB · 100%
From the Hugging Face model README
Will write a proper model card later.
It's Mistral 7B v0.1 finetuned on MaziyarPanahi/magpie-ultra-v0.1-sharegpt for one epoch. GaLore full training. ChatML prompt format. It needs non-zero rep_p sampling, around 1.05. Took around 16 hours on 3090 Ti.