Downloads · 30 days
12
10% of all-time downloads
qwen1.5-1.8B-seed-sft
WDong/qwen1.5-1.8B-seed-sft
qwen1.5-1.8B-seed-sft is a text generation model from WDong. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
All-time downloads
119
Public
Parameters
1.8B
3.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- qwen2
- Access
- Public
- Created
- Apr 22, 2024
- Updated
- Apr 22, 2024
- SHA
- ea814d95
Try a prompt
Model card
From the Hugging Face model README
An sft version of a qwen1.5-1.8B
Introduction
Qwen1.5 is the beta version of Qwen2, a transformer-based decoder-only language model pretrained on a large amount of data. In comparison with the previous released Qwen, the improvements include:
- 8 model sizes, including 0.5B, 1.8B, 4B, 7B, 14B, 32B and 72B dense models, and an MoE model of 14B with 2.7B activated;
- Significant performance improvement in Chat models;
- Multilingual support of both base and chat models;
- Stable support of 32K context length for models of all sizes
- No need of
trust_remote_code.
For more details, please refer to the blog post and GitHub repo.
Our Work
We sft the model on a subset of [Open Assistant dataset](Open Assistant dataset) following self_reward
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- mit
- Languages
- en
- Featherless Ai
- live
- Created
- Apr 22, 2024
- Updated
- Apr 22, 2024