Downloads · 30 days
19
35% of all-time downloads
NEW-Fuse-DeepSeek-R1-AIME-1
radna/NEW-Fuse-DeepSeek-R1-AIME-1
NEW-Fuse-DeepSeek-R1-AIME-1 is a text generation model from radna. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
All-time downloads
55
Public
Parameters
32.8B
65.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors65.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- qwen2
- Access
- Public
- Created
- Mar 12, 2025
- Updated
- Mar 12, 2025
- SHA
- 1ac4f76e
Try a prompt
Model card
From the Hugging Face model README
NEW-Fuse-AIME-1
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the DARE TIES merge method using /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 as a base.
Models Merged
The following models were included in the merge:
- /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
- /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
- /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
- /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
- /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
Configuration
The following YAML configuration was used to produce this model:
base_model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
dtype: bfloat16
merge_method: dare_ties
parameters:
int8_mask: 1.0
normalize: 0.0
slices:
- sources:
- layer_range: [0, 1]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.35244033843752853
- layer_range: [0, 1]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.06565483579026653
- layer_range: [0, 1]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8248923599361199
weight: 0.38461070968524835
- layer_range: [0, 1]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8592460452699369
weight: 0.2709388464832553
- layer_range: [0, 1]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.6541749263416319
weight: 0.33556129068833057
- layer_range: [0, 1]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9426661206524789
weight: 0.0053235629152804664
- sources:
- layer_range: [1, 2]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9488748922395204
weight: 0.14826464617072407
- layer_range: [1, 2]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9131099463854294
weight: 0.0500716728672521
- layer_range: [1, 2]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.03528639404457212
- layer_range: [1, 2]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.2726030572249115
- layer_range: [1, 2]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.12239211353380436
- layer_range: [1, 2]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9635154239911565
weight: 0.21170102977920005
- sources:
- layer_range: [2, 3]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.36980377431194145
- layer_range: [2, 3]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9379968946209096
weight: 0.4105923892761978
- layer_range: [2, 3]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9581657977584064
weight: 0.22436197906860517
- layer_range: [2, 3]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8304501761634047
weight: 0.319948178020794
- layer_range: [2, 3]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9871664200736995
weight: 0.2330494583171301
- layer_range: [2, 3]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.6729079463501024
weight: 0.019625987153301827
- sources:
- layer_range: [3, 4]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9485863817976715
weight: 0.34558356909458027
- layer_range: [3, 4]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.06796959970262986
- layer_range: [3, 4]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8683263873836304
weight: 0.23631196193757625
- layer_range: [3, 4]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.12897658747785207
- layer_range: [3, 4]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8873304359583831
weight: 0.09356346904417376
- layer_range: [3, 4]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9199000783393735
weight: 0.32323945110304375
- sources:
- layer_range: [4, 5]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.22626532519457837
- layer_range: [4, 5]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9303308151499403
weight: 0.22866449319501092
- layer_range: [4, 5]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.012114770324266916
- layer_range: [4, 5]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8262691273376455
weight: 0.1880770093616853
- layer_range: [4, 5]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.6580148272567256
- layer_range: [4, 5]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.006053164452560877
- sources:
- layer_range: [5, 6]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8963288717396416
weight: 0.19450243612974277
- layer_range: [5, 6]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.791368227831232
weight: 0.02572381859402889
- layer_range: [5, 6]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.6409267202920192
weight: 0.33005762288513496
- layer_range: [5, 6]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8230620681157153
weight: 0.2788608064344805
- layer_range: [5, 6]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.34794277506374116
- layer_range: [5, 6]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.8603238495904307
weight: 0.21702807973364863
- sources:
- layer_range: [6, 7]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9209955445213542
weight: 0.08974446616116238
- layer_range: [6, 7]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.8932160714427164
weight: 0.3104783993545368
- layer_range: [6, 7]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9414970547144341
weight: 0.06504213911605598
- layer_range: [6, 7]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.057654213441167196
- layer_range: [6, 7]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9821945836928729
weight: 0.15808303028309914
- layer_range: [6, 7]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7467053899439082
weight: 0.33525672482486385
- sources:
- layer_range: [7, 8]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.1780233459840618
- layer_range: [7, 8]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.6637198537771577
weight: 0.350440019875121
- layer_range: [7, 8]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.051708884503478325
- layer_range: [7, 8]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9018872471355386
weight: 0.28677118290764636
- layer_range: [7, 8]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9108709485880905
weight: 0.1265598944346814
- layer_range: [7, 8]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.041086328510648196
- sources:
- layer_range: [8, 9]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9344819873448885
weight: 0.14958159570120846
- layer_range: [8, 9]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.8950475774498431
weight: 0.12770736183473413
- layer_range: [8, 9]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.29231444574882387
- layer_range: [8, 9]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.2836375863562878
- layer_range: [8, 9]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8016409115061408
weight: 0.5444344731114215
- layer_range: [8, 9]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.1491478960761252
- sources:
- layer_range: [9, 10]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9317774796610699
weight: 0.17259642691510574
- layer_range: [9, 10]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.4891275526164048
- layer_range: [9, 10]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.06226032047681976
- layer_range: [9, 10]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.7193472375209293
weight: 0.021179331761708137
- layer_range: [9, 10]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9493623767409787
weight: 0.2293855220751523
- layer_range: [9, 10]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.8858649669962416
weight: 0.29222706340856736
- sources:
- layer_range: [10, 11]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.6979571275513518
weight: 0.023735569803217782
- layer_range: [10, 11]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9236270062825293
weight: 0.16859473651635182
- layer_range: [10, 11]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.18526269676326299
- layer_range: [10, 11]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9350660069572695
weight: 0.0029221621280073606
- layer_range: [10, 11]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9895653552801078
weight: 0.2058759130527274
- layer_range: [10, 11]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.06466413527070317
- sources:
- layer_range: [11, 12]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.6279945130814091
- layer_range: [11, 12]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.24256131069766823
- layer_range: [11, 12]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.2447996601710355
- layer_range: [11, 12]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.017408971387654848
- layer_range: [11, 12]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.20639036292982904
- layer_range: [11, 12]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7736379676309147
weight: 0.33620172015889555
- sources:
- layer_range: [12, 13]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.3818620713241046
- layer_range: [12, 13]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7539315797503614
weight: 0.12629217690057457
- layer_range: [12, 13]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8631011351825837
weight: 0.07024936053875813
- layer_range: [12, 13]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9243050506620795
weight: 0.16603356264453165
- layer_range: [12, 13]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.7064439770108553
- layer_range: [12, 13]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9707078804463223
weight: 0.1917727733034922
- sources:
- layer_range: [13, 14]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9035937491248339
weight: 0.20684942933884876
- layer_range: [13, 14]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.04062045229132705
- layer_range: [13, 14]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.09652371545953004
- layer_range: [13, 14]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.7204498418796482
weight: 0.1395997755690292
- layer_range: [13, 14]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.134725400133938
- layer_range: [13, 14]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.962863472735488
weight: 0.19544068754739274
- sources:
- layer_range: [14, 15]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8560543604546618
weight: 0.1596539163235574
- layer_range: [14, 15]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.1721068557847252
- layer_range: [14, 15]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9711858017304653
weight: 0.42200633908888024
- layer_range: [14, 15]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9378240211471923
weight: 0.03138822797552815
- layer_range: [14, 15]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.15825350887621872
- layer_range: [14, 15]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.09871857447169267
- sources:
- layer_range: [15, 16]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.38430635558799175
- layer_range: [15, 16]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.2015475291011739
- layer_range: [15, 16]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.14445591261752855
- layer_range: [15, 16]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8603795951417006
weight: 0.2961618979486625
- layer_range: [15, 16]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8580174053646074
weight: 0.14301069206654715
- layer_range: [15, 16]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9717109204302016
weight: 0.13328672591584922
- sources:
- layer_range: [16, 17]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.11107527593944753
- layer_range: [16, 17]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9560507181369473
weight: 0.07368367503319825
- layer_range: [16, 17]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.46261433358045856
- layer_range: [16, 17]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.7924646357268611
weight: 0.11061801788303605
- layer_range: [16, 17]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8444385710697626
weight: 0.10305302346005583
- layer_range: [16, 17]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.0033179983310088756
- sources:
- layer_range: [17, 18]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.11885485419792863
- layer_range: [17, 18]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.27503497205951427
- layer_range: [17, 18]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.11605870572277832
- layer_range: [17, 18]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.027617068554572383
- layer_range: [17, 18]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.16306758931309295
- layer_range: [17, 18]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.22889893069371342
- sources:
- layer_range: [18, 19]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.25063161498642306
- layer_range: [18, 19]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.049954748105031685
- layer_range: [18, 19]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.6586200195059745
weight: 0.24754329216230073
- layer_range: [18, 19]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.7097504913960737
weight: 0.2550043425392273
- layer_range: [18, 19]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8834084153180433
weight: 0.38978515412037573
- layer_range: [18, 19]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.1950877626598588
- sources:
- layer_range: [19, 20]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.261038844209231
- layer_range: [19, 20]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9706444430350814
weight: 0.1268925466636987
- layer_range: [19, 20]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.7007460424648342
weight: 0.20228947344196918
- layer_range: [19, 20]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.076790678467687
- layer_range: [19, 20]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.11955356146006063
- layer_range: [19, 20]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.2229078913547204
- sources:
- layer_range: [20, 21]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9185448618625446
weight: 0.05165852000790261
- layer_range: [20, 21]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.3417497799332185
- layer_range: [20, 21]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.0017734187865023343
- layer_range: [20, 21]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.15065291883212018
- layer_range: [20, 21]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.02092694750775584
- layer_range: [20, 21]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.8221087620644192
weight: 0.015352026000658103
- sources:
- layer_range: [21, 22]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.49113340525127774
- layer_range: [21, 22]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.10078126487271136
- layer_range: [21, 22]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.13522916547535774
- layer_range: [21, 22]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8463870815251355
weight: 0.01017440107626627
- layer_range: [21, 22]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8904244483414491
weight: 0.16213203359513373
- layer_range: [21, 22]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.8744143758375571
weight: 0.09177625364256652
- sources:
- layer_range: [22, 23]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.038138234981707264
- layer_range: [22, 23]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.5807219363288547
weight: 0.3143909820843033
- layer_range: [22, 23]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.16364838395099435
- layer_range: [22, 23]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9739944185674109
weight: 0.26398466553894406
- layer_range: [22, 23]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.21289922167960806
- layer_range: [22, 23]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.909420234746683
weight: 0.06118470770696044
- sources:
- layer_range: [23, 24]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.016238586669195365
- layer_range: [23, 24]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.0674191127475775
- layer_range: [23, 24]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.08924636330686106
- layer_range: [23, 24]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.18865926192306698
- layer_range: [23, 24]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9057614959272517
weight: 0.14952753666206495
- layer_range: [23, 24]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.025478952600610005
- sources:
- layer_range: [24, 25]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8204927776970573
weight: 0.36995116785406174
- layer_range: [24, 25]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.934168195510422
weight: 0.20509317839001168
- layer_range: [24, 25]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.3427482412645266
- layer_range: [24, 25]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.03706819006697437
- layer_range: [24, 25]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.18794113071293173
- layer_range: [24, 25]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.682543816882643
weight: 0.2640077319659903
- sources:
- layer_range: [25, 26]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.26904173102605095
- layer_range: [25, 26]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.8187927395574907
weight: 0.06746446492300981
- layer_range: [25, 26]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.4684163299580099
- layer_range: [25, 26]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.17036632853867986
- layer_range: [25, 26]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.6500524858575425
weight: 0.36960464654343594
- layer_range: [25, 26]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.2791067328283276
- sources:
- layer_range: [26, 27]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.10502658708408241
- layer_range: [26, 27]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7698269154741941
weight: 0.33073559939362185
- layer_range: [26, 27]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.020727132033309892
- layer_range: [26, 27]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.20792079652234302
- layer_range: [26, 27]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.4639379292226603
- layer_range: [26, 27]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7762185845243367
weight: 0.08584305195533527
- sources:
- layer_range: [27, 28]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.7400954357615026
weight: 0.3367454373266633
- layer_range: [27, 28]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.571205975367094
- layer_range: [27, 28]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9044090673153418
weight: 0.037137091677969525
- layer_range: [27, 28]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.09801558194237756
- layer_range: [27, 28]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.058024268735814066
- layer_range: [27, 28]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.903086579972829
weight: 0.10193817509394704
- sources:
- layer_range: [28, 29]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.4929574585773262
- layer_range: [28, 29]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.28060867977109183
- layer_range: [28, 29]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.026590892728238696
- layer_range: [28, 29]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.19141198034510415
- layer_range: [28, 29]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.5960927165572599
weight: 0.114412400199558
- layer_range: [28, 29]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9588873226257536
weight: 0.23210466929877763
- sources:
- layer_range: [29, 30]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.6540253815457119
weight: 0.26676253628350277
- layer_range: [29, 30]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.6064521456724821
weight: 0.32731913275227376
- layer_range: [29, 30]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.37939168265170087
- layer_range: [29, 30]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9044341556516037
weight: 0.20490518434022081
- layer_range: [29, 30]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.858245861387603
weight: 0.17917087234350287
- layer_range: [29, 30]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.6882844641154083
- sources:
- layer_range: [30, 31]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.007150508817157786
- layer_range: [30, 31]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9563254040190147
weight: 0.09103575098086883
- layer_range: [30, 31]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.43790175373766804
- layer_range: [30, 31]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9486698828297574
weight: 0.0818669239466478
- layer_range: [30, 31]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.39833013977879245
- layer_range: [30, 31]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7181908348870916
weight: 0.24121561497284677
- sources:
- layer_range: [31, 32]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.10882054979448666
- layer_range: [31, 32]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7543537234549338
weight: 0.12479083340438962
- layer_range: [31, 32]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.0708097726950752
- layer_range: [31, 32]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.333948814242619
- layer_range: [31, 32]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8977007951960791
weight: 0.10298756332912873
- layer_range: [31, 32]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.4794089660108718
weight: 0.21087998893169188
- sources:
- layer_range: [32, 33]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9370115576544044
weight: 0.02842206610649345
- layer_range: [32, 33]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.25557990331445146
- layer_range: [32, 33]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.06247100876710021
- layer_range: [32, 33]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.3388392565514537
- layer_range: [32, 33]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.3756061798577917
- layer_range: [32, 33]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.10009126737493823
- sources:
- layer_range: [33, 34]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9556503508646775
weight: 0.3970244378117722
- layer_range: [33, 34]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.19285762221371153
- layer_range: [33, 34]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.9020002055955054
- layer_range: [33, 34]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8420359869052865
weight: 0.05429678307661277
- layer_range: [33, 34]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8067384349045997
weight: 0.11235997530357353
- layer_range: [33, 34]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.14904022052788152
- sources:
- layer_range: [34, 35]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9434911210556413
weight: 0.2548247050531814
- layer_range: [34, 35]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9719378514337645
weight: 0.15819291099062346
- layer_range: [34, 35]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.04398329584656263
- layer_range: [34, 35]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.6918354532568436
weight: 0.0854102139896491
- layer_range: [34, 35]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.22535807455552204
- layer_range: [34, 35]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.35693881247164805
- sources:
- layer_range: [35, 36]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9319467891271266
weight: 0.29058568002907836
- layer_range: [35, 36]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7952244776117314
weight: 0.17910477728880925
- layer_range: [35, 36]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.7956790509562062
weight: 0.1438684581908245
- layer_range: [35, 36]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.825456233455119
weight: 0.21040956342605738
- layer_range: [35, 36]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.2711380048826145
- layer_range: [35, 36]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.1213323922087308
- sources:
- layer_range: [36, 37]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.10540127798604942
- layer_range: [36, 37]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.30234245332173515
- layer_range: [36, 37]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.48360309114201594
- layer_range: [36, 37]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.5199760376551235
weight: 0.15791172185500307
- layer_range: [36, 37]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8229819309620275
weight: 0.20292181858545125
- layer_range: [36, 37]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.130673858806438
- sources:
- layer_range: [37, 38]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.3389908967120333
- layer_range: [37, 38]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.8098832799175976
weight: 0.032729969813799886
- layer_range: [37, 38]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.06556489588048102
- layer_range: [37, 38]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9606585552315425
weight: 0.39112937866501835
- layer_range: [37, 38]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.10151217876708106
- layer_range: [37, 38]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9147776170708031
weight: 0.3361818039402313
- sources:
- layer_range: [38, 39]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.07553646917615456
- layer_range: [38, 39]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.18713681607621746
- layer_range: [38, 39]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8066647125365156
weight: 0.1377407178430086
- layer_range: [38, 39]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.7942981092851459
weight: 0.15258533005989686
- layer_range: [38, 39]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9317818891985491
weight: 0.1917799304294585
- layer_range: [38, 39]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.014887699641953689
- sources:
- layer_range: [39, 40]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.20840025067571885
- layer_range: [39, 40]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9782399449646568
weight: 0.2328438946903973
- layer_range: [39, 40]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8995390693540155
weight: 0.03203001507470046
- layer_range: [39, 40]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.931359822067464
weight: 0.23927051033346863
- layer_range: [39, 40]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.32001222942808727
- layer_range: [39, 40]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.10925837419057471
- sources:
- layer_range: [40, 41]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.41651154278513103
- layer_range: [40, 41]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.15562043474854753
- layer_range: [40, 41]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.010757564378272605
- layer_range: [40, 41]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8076181360972706
weight: 0.32394761313424586
- layer_range: [40, 41]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9479478932638606
weight: 0.21045149780131678
- layer_range: [40, 41]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.05057244982605083
- sources:
- layer_range: [41, 42]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8236658041251139
weight: 0.21321322044720487
- layer_range: [41, 42]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9543216813136639
weight: 0.11263172588937082
- layer_range: [41, 42]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9709605318433385
weight: 0.3523451529485697
- layer_range: [41, 42]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.3040953041306902
- layer_range: [41, 42]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.17186154702391532
- layer_range: [41, 42]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9068299422142455
weight: 0.05240246428051881
- sources:
- layer_range: [42, 43]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.09508672685600689
- layer_range: [42, 43]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.22133149029323637
- layer_range: [42, 43]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.7669173526006674
weight: 0.08057282883798367
- layer_range: [42, 43]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.0913965000724602
- layer_range: [42, 43]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.5634995238181923
weight: 0.013003111064234352
- layer_range: [42, 43]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.0463173781438628
- sources:
- layer_range: [43, 44]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.7737123104466118
weight: 0.17942861257500786
- layer_range: [43, 44]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.29415458383167614
- layer_range: [43, 44]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.4348355267146788
- layer_range: [43, 44]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.18303269950667883
- layer_range: [43, 44]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9713390697352875
weight: 0.22507337047150916
- layer_range: [43, 44]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.8137903764931057
weight: 0.04079562353601332
- sources:
- layer_range: [44, 45]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.047062104611051064
- layer_range: [44, 45]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.16846088469030315
- layer_range: [44, 45]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.7880602717133516
weight: 0.2789583731212955
- layer_range: [44, 45]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.32352529491682286
- layer_range: [44, 45]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8949399037061117
weight: 0.2545484290147384
- layer_range: [44, 45]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.09517685873313844
- sources:
- layer_range: [45, 46]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8358580272764898
weight: 0.2855837708760959
- layer_range: [45, 46]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.41479888008593596
- layer_range: [45, 46]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.2550535659664166
- layer_range: [45, 46]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.28139845163428256
- layer_range: [45, 46]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8980539982908744
weight: 0.12713384155889973
- layer_range: [45, 46]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.004351098386697783
- sources:
- layer_range: [46, 47]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.38857173097398257
- layer_range: [46, 47]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.14163401231091394
- layer_range: [46, 47]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8868499716013419
weight: 0.25483408300091354
- layer_range: [46, 47]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8490612361146361
weight: 0.3838493668524031
- layer_range: [46, 47]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.2134383937085923
- layer_range: [46, 47]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.29351791671961525
- sources:
- layer_range: [47, 48]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.7592788632718213
weight: 0.21580100444026937
- layer_range: [47, 48]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.11563748273172356
- layer_range: [47, 48]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8238278678209028
weight: 0.12046149405569524
- layer_range: [47, 48]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.7027924239196756
weight: 0.08545622694966344
- layer_range: [47, 48]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.11400029849999294
- layer_range: [47, 48]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.1385923431877603
- sources:
- layer_range: [48, 49]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.26847461441506426
- layer_range: [48, 49]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9989059042448725
weight: 0.02755706551909709
- layer_range: [48, 49]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.29454458599205624
- layer_range: [48, 49]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.21027571525323657
- layer_range: [48, 49]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.05698290419859764
- layer_range: [48, 49]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7984875107617855
weight: 0.008106935637840706
- sources:
- layer_range: [49, 50]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.06730944082274636
- layer_range: [49, 50]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.056144623361766885
- layer_range: [49, 50]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9456462618822497
weight: 0.14816750915525348
- layer_range: [49, 50]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9456887334985299
weight: 0.010656517207506516
- layer_range: [49, 50]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.18034550821096046
- layer_range: [49, 50]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.2614189069253616
- sources:
- layer_range: [50, 51]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.09036514284084263
- layer_range: [50, 51]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.2793847527781395
- layer_range: [50, 51]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.7823494966044564
weight: 0.1918617933005795
- layer_range: [50, 51]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.06742144092010083
- layer_range: [50, 51]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.08939312333251181
- layer_range: [50, 51]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.833744405837781
weight: 0.2569366887908943
- sources:
- layer_range: [51, 52]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.204580104229255
- layer_range: [51, 52]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.5650841458103742
weight: 0.05931790715471086
- layer_range: [51, 52]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.778532619712101
weight: 0.19801357088299154
- layer_range: [51, 52]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8282432512063711
weight: 0.3503101423420888
- layer_range: [51, 52]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.16037771860597982
- layer_range: [51, 52]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.056630800646782664
- sources:
- layer_range: [52, 53]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8102173034683241
weight: 0.17436162327079358
- layer_range: [52, 53]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.053046951706820056
- layer_range: [52, 53]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.27843953938291616
- layer_range: [52, 53]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.15918211869367555
- layer_range: [52, 53]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8007638182050225
weight: 0.032818586693711294
- layer_range: [52, 53]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.17033249682303778
- sources:
- layer_range: [53, 54]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.09624555984301572
- layer_range: [53, 54]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.5571652220837998
weight: 0.04953328492569409
- layer_range: [53, 54]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.041116739637920924
- layer_range: [53, 54]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.17225873901498326
- layer_range: [53, 54]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.5226491226347826
weight: 0.2782408228603738
- layer_range: [53, 54]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.3032589409329551
- sources:
- layer_range: [54, 55]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9304345418952316
weight: 0.032364817446169286
- layer_range: [54, 55]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.39179869867982725
- layer_range: [54, 55]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8150966766025997
weight: 0.02288042804967988
- layer_range: [54, 55]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.1789626519265678
- layer_range: [54, 55]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8910058256154507
weight: 0.20471189803004364
- layer_range: [54, 55]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.13970624095073508
- sources:
- layer_range: [55, 56]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8053976349102374
weight: 0.2840366733935171
- layer_range: [55, 56]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9537785616138238
weight: 0.04358059246606438
- layer_range: [55, 56]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.24477013102149628
- layer_range: [55, 56]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9585712571206357
weight: 0.37102592178522487
- layer_range: [55, 56]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8998251608652412
weight: 0.39569695763453694
- layer_range: [55, 56]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.14637293332966364
- sources:
- layer_range: [56, 57]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.898055237651287
weight: 0.057788054342290326
- layer_range: [56, 57]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.24981253173887333
- layer_range: [56, 57]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.7804588723814723
weight: 0.44130754723160515
- layer_range: [56, 57]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8842003107758944
weight: 0.0008712317185377572
- layer_range: [56, 57]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.11582432992359575
- layer_range: [56, 57]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.8776343698470468
weight: 0.12743969299538765
- sources:
- layer_range: [57, 58]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.01377373448756325
- layer_range: [57, 58]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.925005411207583
weight: 0.31944303509866195
- layer_range: [57, 58]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8762567459720589
weight: 0.2990916989904438
- layer_range: [57, 58]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.30495949216462254
- layer_range: [57, 58]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8839795316361178
weight: 0.24258010470545116
- layer_range: [57, 58]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.12604448444251193
- sources:
- layer_range: [58, 59]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.724670014865185
weight: 0.24511684858463265
- layer_range: [58, 59]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.4349914719295033
- layer_range: [58, 59]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.2026461684035123
- layer_range: [58, 59]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.2051083755305495
- layer_range: [58, 59]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.08276720148098043
- layer_range: [58, 59]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9009273902277648
weight: 0.1254339189305163
- sources:
- layer_range: [59, 60]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9466214229369014
weight: 0.3403510978774423
- layer_range: [59, 60]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.17569006036341767
- layer_range: [59, 60]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.019809874547022877
- layer_range: [59, 60]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.057565875154789975
- layer_range: [59, 60]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8381886677136565
weight: 0.0737289532231587
- layer_range: [59, 60]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.892209341014166
weight: 0.24307087184793097
- sources:
- layer_range: [60, 61]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9951552547915052
weight: 0.19712510079989057
- layer_range: [60, 61]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.5619165612671431
- layer_range: [60, 61]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8781048804500454
weight: 0.26190386780513264
- layer_range: [60, 61]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.7316121364951871
weight: 0.13798543588037673
- layer_range: [60, 61]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.28118540067796494
- layer_range: [60, 61]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9768004959403602
weight: 0.10847809141549553
- sources:
- layer_range: [61, 62]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.007750679801211385
- layer_range: [61, 62]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.08089462228857118
- layer_range: [61, 62]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8393212930792688
weight: 0.22937555333464804
- layer_range: [61, 62]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9793604094050525
weight: 0.07184083460820315
- layer_range: [61, 62]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9182862858497272
weight: 0.4506195904381331
- layer_range: [61, 62]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.16547976349593468
- sources:
- layer_range: [62, 63]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.4665122813434508
- layer_range: [62, 63]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.851187623811185
weight: 0.061043514475124655
- layer_range: [62, 63]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.565587088161311
- layer_range: [62, 63]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.11058276936579046
- layer_range: [62, 63]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.18513626419830287
- layer_range: [62, 63]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9388107295104234
weight: 0.4570799451538212
- sources:
- layer_range: [63, 64]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9948294171948843
weight: 0.03137695207967589
- layer_range: [63, 64]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.6675709065596998
weight: 0.3221447497043656
- layer_range: [63, 64]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9587013647644738
weight: 0.10573015996836115
- layer_range: [63, 64]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.12008206027963769
- layer_range: [63, 64]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.0765927728276577
- layer_range: [63, 64]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.3810624649836515
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- Created
- Mar 12, 2025
- Updated
- Mar 12, 2025