Downloads · 30 days
4
10% of all-time downloads
wandb_-_mistral-7b-zephyr-sft-8bits
RichardErkhov/wandb_-_mistral-7b-zephyr-sft-8bits
wandb_-_mistral-7b-zephyr-sft-8bits is a text generation model from RichardErkhov. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
42
Public
Parameters
7.2B
7.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.5 GB · 100%
Parameter types
How the weights are stored.
I87B · 96%
Try a prompt
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
mistral-7b-zephyr-sft - bnb 8bits
- Model creator: https://huggingface.co/wandb/
- Original model: https://huggingface.co/wandb/mistral-7b-zephyr-sft/
Original model description:
license: mit library_name: transformers datasets:
- HuggingFaceH4/deita-10k-v0-sft base_model: mistralai/Mistral-7B-v0.1
Mistral 7B Zephyr SFT V2
The Zephyr SFT recipe applied on top of Mistral 7B (new recipe with chatML format)
Model description
- Model type: A 7.2B parameter GPT-like model fine-tuned on a mix of publicly available, synthetic datasets.
- Language(s) (NLP): Primarily English
- Finetuned from model: mistralai/Mistral-7B-v0.1
Recipe
We trained using the alignment handbook recipe and logging to W&B
Visit the W&B workspace here
Compute provided by Lambda Labs - 8xA100 80GB node
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- Created
- May 16, 2024
- Updated
- May 16, 2024