Downloads · 30 days
376
2% of all-time downloads
ESFT-vanilla-lite
deepseek-ai/ESFT-vanilla-lite
ESFT-vanilla-lite is a text generation model from deepseek-ai. Use it when you need the model to write or continue text. It is set up for transformers.
The vanilla model used in our Expert-Specialized Fine-Tuning (ESFT) research paper: https://arxiv.org/abs/2407.01906.
All-time downloads
16.8K
Public
Parameters
15.7B
31.4 GB on disk
Likes
21
Public
Repo makeup
Click a slice to open those files.
.safetensors31.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- deepseek_v2
- Access
- Public
- Created
- Jul 4, 2024
- Updated
- Jul 23, 2024
- SHA
- d3eed002
Try a prompt
Model card
From the Hugging Face model README
The vanilla model used in our Expert-Specialized Fine-Tuning (ESFT) research paper: https://arxiv.org/abs/2407.01906.
To use this model and specialized expert sets, please refer to the scripts at https://github.com/deepseek-ai/ESFT.
For the customized models used in this paper, please refer to https://huggingface.co/deepseek-ai/ESFT-{gate, token}-{task_name}-lite.
- Task
- Text Generation
- Library
- transformers
- Type
- deepseek_v2
- Created
- Jul 4, 2024
- Updated
- Jul 23, 2024