OrionOmegaFiction-26B-A4B

26B-Suite/OrionOmegaFiction-26B-A4B

OrionOmegaFiction-26B-A4B is a machine learning model from 26B-Suite. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Downloads · 30 days

11% of all-time downloads

All-time downloads

Public

Repo size

4.8 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors4.7 GB · 99%

At a glance

Model type: gemma4
Access: Public
Created: Sep 2, 2026
Updated: Sep 2, 2026
SHA: c0330f94

Model card

From the Hugging Face model README

A test to see if HB16 produce artifacts

architecture: Gemma4ForConditionalGeneration
base_model: B:\26B\google--gemma-4-26B-A4B-it
models:
  - model: B:\26B\electroglyph--gemma4-26b-fiction-bf16
    parameters:
      weight:
        - filter: "lm_head"
          value: 1.0
        - filter: "attn"
          value: 1.0
        - filter: "embed_tokens"
          value: 1.0
        - value: 1.0
      density: 0.9
      epsilon: 0.09
  - model: B:\26B\ReadyArt--Omega-Evolution-26B-A4B-v3.0-HB16-Q8_0
    parameters:
      weight:
        - filter: "lm_head"
          value: 1.0
        - filter: "attn"
          value: 1.0
        - filter: "embed_tokens"
          value: 1.0
        - value: 1.0
      density: 0.9
      epsilon: 0.09
  - model: B:\26B\TheDrummer--Orion-26B-A4B-v1
    parameters:
      weight:
        - filter: "lm_head"
          value: 1.0
        - filter: "attn"
          value: 1.0
        - filter: "embed_tokens"
          value: 1.0
        - value: 1.0
      density: 0.9
      epsilon: 0.09
merge_method: moe_della
parameters:  
  lambda: 1.0
  normalize_weights: true
  normalize_router: true
  int8_mask: false
  rescale: true
  router_strategy: della
  blend_experts: true
dtype: float32
out_dtype: bfloat16
tokenizer:
  source: union
chat_template: auto

Type: gemma4
Created: Sep 2, 2026
Updated: Sep 2, 2026