Harmony-Bird-12B

<div style="max-width:1000px;margin:40px auto 24px;padding:0 12px;"> <div style=" background: radial-gradient(circle at 30% 50%, rgba(0,40,80,0.35), rgba(0,10,30,0.88)); border:1px solid rgba(20,120,180,0.35); border-radius:12px; box-shadow:0 0 25px rgba(0,100,180,0.3), inset 0 0 25px rgba(0,80,140,0.2); overflow:hidden;"> <div style="padding:28px 22px;text-align:center;"> <h1 style="margin:0;font-size:2.2rem;letter-spacing:2px;text-transform:uppercase; background:linear-gradient(90deg,#6de6ff,#005d8c); -webkit-background-clip:text;-webkit-text-fill-color:transparent; text-shadow:0 0 12px rgba(80,200,255,0.4); font-family:ui-sans-serif,system-ui,Segoe UI,Roboto,Inter,Arial;"> Harmony Bird 12B </h1> </div> </div> </div> <div style="height:8px;max-width:900px;margin:25px auto 10px; background:radial-gradient(circle, rgba(0,60,90,0.25), rgba(0,10,20,0.95)); border-radius:50%;box-shadow:inset 0 0 10px rgba(0,100,140,0.35);"></div> <div style="max-width:1000px;margin:0 auto 25px;padding:0 12px;text-align:center;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/6669a3a617b838fda45637b8/t_aOB1_Ae182GNLcvV9dm.png" style="width:100%;max-width:960px;border-radius:12px; border:1px solid rgba(60,160,200,0.4); box-shadow:0 0 22px rgba(60,140,180,0.3), inset 0 0 8px rgba(100,220,255,0.15);" /> </div> <div style="height:8px;max-width:900px;margin:10px auto 30px; background:radial-gradient(circle, rgba(0,60,90,0.25), rgba(0,10,20,0.95)); border-radius:50%;box-shadow:inset 0 0 10px rgba(0,100,140,0.35);"></div> <!-- 01 // Overview --> <div style="max-width:1000px;margin:0 auto 28px;padding:0 12px;"> <div style=" background:radial-gradient(circle at 30% 50%, rgba(0,40,80,0.35), rgba(0,10,30,0.88)); border:1px solid rgba(20,120,180,0.35); border-radius:12px;overflow:hidden; box-shadow:0 0 25px rgba(0,100,180,0.3), inset 0 0 25px rgba(0,80,140,0.2);"> <div style="padding:12px 18px;background:linear-gradient(90deg, rgba(0,100,140,0.3), rgba(0,40,80,0.4)); border-bottom:1px solid rgba(30,160,220,0.15);"> <h2 style="margin:0;color:#d8f8ff;font-size:1.05rem;letter-spacing:1px;text-transform:uppercase;"> 01 // Overview </h2> </div> <div style="padding:18px 22px;color:#e8f9ff;"> <p style="margin:0 0 10px;"> <strong>Harmony-Bird-12B</strong> is a merged model intended for roleplay and storytelling. </p> <p style="margin:0;">Built with <a href="https://github.com/arcee-ai/mergekit" target="_blank" style="color:#5ad6ff;text-decoration:none;">MergeKit</a>.</p> </div> </div> </div> <!-- 02 // Merge Step 1 --> <div style="max-width:1000px;margin:0 auto 28px;padding:0 12px;"> <div style="background:radial-gradient(circle at 30% 50%, rgba(0,40,80,0.35), rgba(0,10,30,0.88)); border:1px solid rgba(20,120,180,0.35);border-radius:12px;overflow:hidden; box-shadow:0 0 25px rgba(0,100,180,0.3), inset 0 0 25px rgba(0,80,140,0.2);"> <div style="padding:12px 18px;background:linear-gradient(90deg, rgba(0,100,140,0.3), rgba(0,40,80,0.4)); border-bottom:1px solid rgba(30,160,220,0.15);"> <h2 style="margin:0;color:#d8f8ff;font-size:1.05rem;letter-spacing:1px;text-transform:uppercase;"> 02 // Merge Step 1 </h2> </div> <div style="padding:18px 22px;color:#e8f9ff;"> <p style="margin:0 0 12px;"> <a href="https://huggingface.co/Vortex5/Vermilion-Sage-12B" target="_blank" style="color:#5ad6ff;text-decoration:none;">Vermilion-Sage-12B</a> merges with <a href="https://huggingface.co/SicariusSicariiStuff/Impish_Nemo_12B" target="_blank" style="color:#5ad6ff;text-decoration:none;">Impish-Nemo-12B</a> using the <code>harmony_forge</code> method (<code>focus=8.0</code>, <code>blend=0.7</code>). </p> <details> <summary style="cursor:pointer;color:#6be3ff;font-weight:600;margin:0 0 6px;">Show YAML</summary> <pre style="background:#0a0a0a;color:#fff;padding:14px;border-left:3px solid #3ab8e0;border-radius:8px; overflow:auto;font-size:13px;white-space:pre;">merge_method: harmony_forge models: - model: Vortex5/Vermilion-Sage-12B - model: SicariusSicariiStuff/Impish_Nemo_12B parameters: focus: 8.0 blend: 0.7 tokenizer: source: union dtype: bfloat16</pre> </details> </div> </div> </div> <!-- 03 // What is this merge method? --> <div style="max-width:1000px;margin:0 auto 28px;padding:0 12px;"> <div style="background:radial-gradient(circle at 30% 50%, rgba(0,40,80,0.35), rgba(0,10,30,0.88)); border:1px solid rgba(20,120,180,0.35);border-radius:12px;overflow:hidden; box-shadow:0 0 25px rgba(0,100,180,0.3), inset 0 0 25px rgba(0,80,140,0.2);"> <div style="padding:12px 18px;background:linear-gradient(90deg, rgba(0,100,140,0.3), rgba(0,40,80,0.4)); border-bottom:1px solid rgba(30,160,220,0.15);"> <h2 style="margin:0;color:#d8f8ff;font-size:1.05rem;letter-spacing:1px;text-transform:uppercase;"> 03 // Custom merge method </h2> </div> <div style="padding:18px 22px;color:#e8f9ff;"> <p style="margin:0 0 12px;"> It is a custom adaptive merge method that blends models through consensus weighting across both **spatial** (parameter alignment) and **frequency** (spectral structure) domains. It is designed for stable, noise-resistant merges that preserve the shared strengths of multiple models while reducing conflicts and outlier effects. It supports standard and task-vector merging (when a `base_model` is provided). **How it works:** The method first centers all model weights (relative to either a `base_model` or their median) and normalizes their scales to ensure balance. It then analyzes correlations in parameter space (spatial features) and in the frequency domain (via FFT) to measure similarity and coherence between models. Each model receives a *goodness score* based on how well it aligns with others, adjusted by stability and outlier suppression terms.

These scores are converted into normalized merge weights using a softmax function, which smoothly scales scores so that higher values receive more weight while all weights sum to 1. The focus parameter controls how sharply these weights are distributed — low focus blends models evenly, while high focus concentrates more weight on the most consistent ones. The blend parameter mixes how much spatial versus frequency information influences the final weighting. The merged parameters are then computed as a weighted sum across models.

Key parameters:

• focus: Controls decisiveness of weighting (higher = more selective). Default: 1.0
• blend: Uses a 0–1 scale to control merge emphasis — 0 represents full reliance on spatial similarity, meaning model weights are compared directly in parameter space. 1 represents full reliance on frequency-domain similarity, where weights are compared by their spectral (FFT) patterns. Default: 0.5 blends both equally for balanced structural and behavioral alignment.

By weighting models through adaptive consensus across spatial and frequency domains, Harmony Forge emphasizes aligned, stable patterns—encouraging coherent, balanced merges that often inherit the strongest traits of each source model. </div>

</div> </div> <!-- 05 // Acknowledgments --> <div style="max-width:1000px;margin:0 auto 40px;padding:0 12px;"> <div style="background:radial-gradient(circle at 30% 50%, rgba(0,40,80,0.35), rgba(0,10,30,0.88)); border:1px solid rgba(20,120,180,0.35);border-radius:12px;overflow:hidden; box-shadow:0 0 25px rgba(0,100,180,0.3), inset 0 0 25px rgba(0,80,140,0.2);"> <div style="padding:12px 18px;background:linear-gradient(90deg, rgba(0,100,140,0.3), rgba(0,40,80,0.4)); border-bottom:1px solid rgba(30,160,220,0.15);"> <h2 style="margin:0;color:#d8f8ff;font-size:1.05rem;letter-spacing:1px;text-transform:uppercase;"> 05 // Acknowledgments </h2> </div> <div style="padding:18px 22px;color:#e8f9ff;"> <ul style="list-style:none;padding-left:10px;line-height:1.8;margin:0;"> <li> <strong><a href="https://huggingface.co/mradermacher" target="_blank" style="color:#6be3ff;text-decoration:none;">Team Mradermacher</a></strong> — Static & imatrix quantizations</li> <li> <strong><a href="https://huggingface.co/DeathGodlike" target="_blank" style="color:#6be3ff;text-decoration:none;">DeathGodlike</a></strong> — EXL3 quants</li> <li> <strong><span style="color:#6be3ff;">Original model authors and contributors whose work made this model possible.</strong></li> </ul> </div> </div> </div>