Downloads · 30 days
18
0% of all-time downloads
UltraQwen-7B
Locutusque/UltraQwen-7B
UltraQwen-7B is a text generation model from Locutusque. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
The model was trained on about 100,000 examples of the HuggingFaceH4/ultrachat200k dataset, with plans to release more checkpoints later on.
All-time downloads
8.5K
Public
Parameters
7.7B
15.4 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors15.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Jan 21, 2024
- Updated
- Jan 21, 2024
- SHA
- 0c029182
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Model description
The model was trained on about 100,000 examples of the HuggingFaceH4/ultrachat_200k dataset, with plans to release more checkpoints later on.
This model has not been aligned with DPO. In the future, different repositories will be released that contain versions of this model aligned with DPO, using various datasets.
Evaluation
Upon personal testing, the model demonstrates excellent performance in mathematics, history, trivia, and coding tasks. This model can be found on the Open LLM Leaderboard.
Recommended inference parameters
temperature=0.2, top_p=0.14, top_k=12, repetition_penalty=1.1
License
Please make sure to read the Qwen licensing agreement before using this model.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Languages
- en
- Created
- Jan 21, 2024
- Updated
- Jan 21, 2024