Downloads · 30 days
15
23% of all-time downloads
Qwen2.5-0.5B-Abyss
Novaciano/Qwen2.5-0.5B-Abyss
Qwen2.5-0.5B-Abyss is a text generation model from Novaciano. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
All-time downloads
64
Public
Parameters
630M
2.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.5 GB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- qwen2
- Access
- Public
- Created
- Mar 11, 2025
- Updated
- Mar 11, 2025
- SHA
- 320b3ab3
Base models
Datasets
Model card
From the Hugging Face model README
merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
<center><b>The Brothers</b><img src="https://i.ibb.co/prXNXXN7/IMG-20250311-031904.jpg" alt="IMG-20250311-031904" border="0"></a>
Both is the combination of the best models QWEN2.5-0.5B of the Open LLM Leaderscore.
</center>Merge Method
This model was merged using the Arcee Fusion merge method using CoolSpring/Qwen2-0.5B-Abyme-merge3 as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: FlofloB/100k_fineweb_continued_pretraining_Qwen2.5-0.5B-Instruct_Unsloth_merged_16bit
- model: CoolSpring/Qwen2-0.5B-Abyme-merge3
parameters:
density: 0.53
weight: 0.6
merge_method: arcee_fusion
base_model: CoolSpring/Qwen2-0.5B-Abyme-merge3
tokenizer_source: union
parameters:
int8_mask: true
dtype: bfloat16
random_seed: 0
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- Languages
- es, en
- Created
- Mar 11, 2025
- Updated
- Mar 11, 2025