Downloads · 30 days
8
9% of all-time downloads
R3-Qwen3-4B_merged_linear_5model
rubricreward/R3-Qwen3-4B_merged_linear_5model
R3-Qwen3-4B_merged_linear_5model is a text generation model from rubricreward. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
All-time downloads
93
Public
Parameters
4B
8.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- qwen3
- Access
- Public
- Created
- Jul 19, 2025
- Updated
- Jul 22, 2025
- SHA
- ac82abde
Try a prompt
Base models
Model card
From the Hugging Face model README
R3-Qwen3-4B_merged_linear_5model
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the Linear merge method.
Models Merged
The following models were included in the merge:
- rubricreward/R3-Qwen3-4B-14k
- rubricreward/R3-Qwen3-4B-5K-v1.1
- rubricreward/R3-Qwen3-4B-15K-v1.1
- rubricreward/R3-Qwen3-4B-4k
- Qwen/Qwen3-4B
Configuration
The following YAML configuration was used to produce this model:
models:
- model: Qwen/Qwen3-4B
parameters:
weight: 0.05
- model: rubricreward/R3-Qwen3-4B-4k
parameters:
weight: 0.2
- model: rubricreward/R3-Qwen3-4B-14k
parameters:
weight: 0.25
- model: rubricreward/R3-Qwen3-4B-5K-v1.1
parameters:
weight: 0.25
- model: rubricreward/R3-Qwen3-4B-15K-v1.1
parameters:
weight: 0.25
merge_method: linear
dtype: bfloat16
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3
- Created
- Jul 19, 2025
- Updated
- Jul 22, 2025