mixtral-expert-routing

Reading How a Mixture-of-Experts Model Routes Its Inputs

Using Authentrics to read how Mixtral's mixture-of-experts routes activations and how that structure emerges across training — interpretability without touching your weights remotely.

Authentrics is a high-performance neural-network analysis library (Python wheel over a C++ core). It audits and maintains model checkpoints: parameter/behavioral drift, compliant data removal without full retraining, and loss-driven optimization without backprop. Analysis runs locally on your machine — only project metadata (names, descriptions) is exchanged with Authentrics servers, never your model weights.

What this demo shows

• activation_analysis — catch behavioral drift in intermediate activations.
• correlation_analysis — see how strongly each layer influences a reference (usually output) layer.

Reproduce this analysis

The public code and outputs behind this demo live in https://github.com/Authentrics-ai/authentrics-model-analysis-experiments#mistralmixtral-moe-expert-activation.

Outputs (JSON + Plotly HTML dashboards) are published under output/mistral_moe_expert_activation/.

Weights: Interpretability walkthrough on mistralai/Mixtral-8x7B-v0.1; no derived weights are published. Reproduce the analysis locally with the SDK below.

Reproduce it yourself

pip install authentrics            # Linux x86_64, Python 3.11–3.13
authrx init                        # paste API key (stored at ~/.local/state/authentrics/api_key)
# or, for CI / non-interactive:
export AUTHRX_API_KEY=<your_api_key>

Generate an API key and read the full docs at https://app.authentrics.ai/.

---

Produced with the Authentrics SDK v0.35.1 — checkpoint analysis that runs locally on your own hardware; only project metadata ever leaves your machine, never your weights.

Links

• App & API keys: https://app.authentrics.ai/
• Docs & API reference: https://app.authentrics.ai/docs
• Examples & user guide: https://github.com/Authentrics-ai/authentrics-analysis-examples
• Contact: [email protected]