Downloads · 30 days
15
19% of all-time downloads
unsloth_fp16_vllm
ssparsh36/unsloth_fp16_vllm
unsloth_fp16_vllm is a text generation model from ssparsh36. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: ssparsh36 - License: apache-2.0 - Finetuned from model : unsloth/mistral-7b-bnb-4bit
All-time downloads
77
Public
Repo size
29 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Jul 12, 2024
- Updated
- Jul 12, 2024
- SHA
- ab3fcea5
Try a prompt
Base models
Model card
From the Hugging Face model README
Uploaded model
- Developed by: ssparsh36
- License: apache-2.0
- Finetuned from model : unsloth/mistral-7b-bnb-4bit
This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Languages
- en
- Created
- Jul 12, 2024
- Updated
- Jul 12, 2024