Downloads · 30 days
41
9% of all-time downloads
UltraQwen-1_8B
Locutusque/UltraQwen-1_8B
UltraQwen-1_8B is a text generation model from Locutusque. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
The model was trained on about 20,000 examples of the HuggingFaceH4/ultrachat200k dataset, with plans to release more checkpoints later on.
All-time downloads
467
Public
Parameters
1.8B
22.1 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin3.7 GB · 50%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- qwen
- Access
- Public
- Created
- Jan 16, 2024
- Updated
- Jan 18, 2024
- SHA
- 4a628d53
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Model description
The model was trained on about 20,000 examples of the HuggingFaceH4/ultrachat_200k dataset, with plans to release more checkpoints later on.
This model has not been aligned with DPO. In the future, different repositories will be released that contain versions of this model aligned with DPO, using various datasets.
Evaluation
Upon personal testing, the model demonstrates excellent performance in mathematics, history, and coding tasks.
However, due to the model's requirement for the setting trust_remote_code=True, it cannot be submitted to the Open LLM Leaderboard. As a result, I will release a llama-fied version of this model that can be submitted to the Open LLM leaderboard.
Recommended inference parameters
temperature=0.2, top_p=0.14, top_k=12, repetition_penalty=1.1
License
Please make sure to read the Qwen licensing agreement before using this model.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen
- License
- other
- Languages
- en
- Created
- Jan 16, 2024
- Updated
- Jan 18, 2024