Downloads · 30 days
18
17% of all-time downloads
Medusa2-Mistral-7B-Instruct-v0.2
EmbeddedLLM/Medusa2-Mistral-7B-Instruct-v0.2
Medusa2-Mistral-7B-Instruct-v0.2 is a text generation model from EmbeddedLLM. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a Medusa model for Mistral 7B Instruct v0.2. This is trained using the latest Medusa 2 commit.
All-time downloads
107
Public
Repo size
31.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin16 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Jan 24, 2024
- Updated
- Jan 26, 2024
- SHA
- e9457e8d
Try a prompt
Model card
From the Hugging Face model README
Model Description
This is a Medusa model for Mistral 7B Instruct v0.2. This is trained using the latest Medusa 2 commit.
Training:
- Dataset used is the self distillation dataset from Mistral 7B Instruct v0.2, temperature 0.3 with output token of 2048.
- It has been trained using axolotl fork as describe in Medusa 2 README.md
Inference:
- To load the model please follow the instruction found in Github
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Created
- Jan 24, 2024
- Updated
- Jan 26, 2024