Downloads · 30 days
20
17% of all-time downloads
CleverQwen2-1.5B
trollek/CleverQwen2-1.5B
CleverQwen2-1.5B is a text generation model from trollek. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a merge of pre-trained language models created using mergekit.
All-time downloads
116
Public
Parameters
1.8B
3.6 GB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors3.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Jul 6, 2024
- Updated
- Jul 6, 2024
- SHA
- 331c2504
Try a prompt
Base models
Model card
From the Hugging Face model README
CleverQwen2-1.5B
This is a merge of pre-trained language models created using mergekit.
It has grown by about 300M parameters and I don't know why. I would like to know though. It works as expexted - amazing - I just can't see any reason for the Qwen2 models to gain parameters when merged.
Merge Details
Merge Method
This model was merged using the Model Stock merge method using trollek/Qwen2-1.5B-Instruct-Abliterated as a base.
Models Merged
The following models were included in the merge:
- cognitivecomputations/dolphin-2.9.3-qwen2-1.5b
- M4-ai/Hercules-5.0-Qwen2-1.5B
- Replete-AI/Replete-Coder-Qwen2-1.5b
Configuration
The following YAML configuration was used to produce this model:
models:
- model: Replete-AI/Replete-Coder-Qwen2-1.5b
- model: M4-ai/Hercules-5.0-Qwen2-1.5B
- model: cognitivecomputations/dolphin-2.9.3-qwen2-1.5b
merge_method: model_stock
base_model: trollek/Qwen2-1.5B-Instruct-Abliterated
architecture: qwen2
dtype: bfloat16
Quants
Ollama
ollama pull trollek/cleverqwen2:1.5b-q4_k_s
ollama pull trollek/cleverqwen2:1.5b-q5_k_s
ollama pull trollek/cleverqwen2:1.5b-q6_k
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Jul 6, 2024
- Updated
- Jul 6, 2024