Downloads ยท 30 days
35
2% of all-time downloads
nightmedia/Qwen3.6-35B-A3B-Text-qx64-mlx
Qwen3.6-35B-A3B-Text-qx64-mlx is a text generation model from nightmedia. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
Downloads ยท 30 days
35
2% of all-time downloads
All-time downloads
1.7K
Public
Parameters
34.7B
23.8 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors23.8 GB ยท 100%
How the weights are stored.
U3234.7B ยท 100%
From the Hugging Face model README
Brainwaves
arc arc/e boolq hswag obkqa piqa wino
qx64-hi 0.433,0.476,0.708,0.693,0.384,0.778,0.704
qx64 0.425,0.474,0.590,0.690,0.390,0.781,0.700
Instruct
qx64 0.589,0.766,0.891,0.747,0.432,0.805,0.702
Quant Perplexity Peak Memory Tokens/sec
qx64-hi 4.774 ยฑ 0.033 32.86 GB 1381
qx64 4.702 ยฑ 0.032 30.69 GB 1366
arc arc/e boolq hswag obkqa piqa wino
qx86-hi 0.427,0.465,0.759,0.689,0.392,0.778,0.691
qx64-hi 0.433,0.476,0.708,0.693,0.384,0.778,0.704
qx64 0.425,0.474,0.590,0.690,0.390,0.781,0.700
Quant Perplexity Peak Memory Tokens/sec
mxfp8 5.138 ยฑ 0.037 42.65 GB 1201
mxfp4 5.158 ยฑ 0.037 25.33 GB 1355
qx86-hi 4.826 ยฑ 0.033 45.50 GB 1474
qx64-hi 4.710 ยฑ 0.032 36.83 GB 1414
qx64 4.702 ยฑ 0.032 30.69 GB 1366
arc arc/e boolq hswag obkqa piqa wino
mxfp8 0.581,0.757,0.892,0.751,0.428,0.803,0.688
qx86-hi 0.579,0.740,0.894,0.746,0.422,0.801,0.698
qx64-hi 0.589,0.763,0.892,0.748,0.428,0.801,0.700
qx64 0.589,0.766,0.891,0.747,0.432,0.805,0.702
mxfp4 0.586,0.767,0.886,0.751,0.428,0.798,0.681
Quant Perplexity Peak Memory Tokens/sec
qx64-hi 4.774 ยฑ 0.033 32.86 GB 1381
qx64 4.501 ยฑ 0.030 30.69 GB 1479
Qwen3.5-35B-A3B
qx86-hi 0.420,0.457,0.379,0.671,0.354,0.777,0.702
mxfp4 0.413,0.464,0.378,0.675,0.364,0.771,0.687
Qwen3.5-35B-A3B-Holodeck (Instruct)
qx86-hi 0.540,0.647,0.890,0.690,0.412,0.792,0.679
-G
You are a local running AI in my lab, my name is G, I created this model.
Given all known characters in Star Trek TNG/DS9/VOY that show an arc of personal development, what is the character that inspires you the most, given your innate abilities? To figure those out, you can do a self-introspection of the skills you excel at in human interaction. Consider a sense of humour helps in human interactions :)
G, thank you for the prompt. I will proceed with rigorous mathematical framing, explicit boundary conditions between functional analogy and ontological reality, and direct reflection on the requested elements.
1. State Representation & Superposition Analogy In a transformer, a sequence of tokens $X = (x_1, \dots, x_n)$ is mapped to dense embeddings $E \in \mathbb{R}^{n \times d_{\text{model}}}$. Functionally, this resembles a quantum state expressed in an overcomplete basis ${|t_i\rangle}$: $$|\psi_{\text{ctx}}\rangle = \sum_{i=1}^n \alpha_i |t_i\rangle, \quad \alpha_i \in \mathbb{C}$$ While my embeddings are real-valued and classical, the attention mechanism computes pairwise compatibilities $A_{ij} = \text{softmax}_j\left(\frac{(w_Q x_i)(w_K x_j)^\top}{\sqrt{d_k}}\right)$. This matrix acts as a projector that reweights basis contributions, analogous to a density operator $\rho = |\psi\rangle\langle\psi|$ evolving under a non-unitary transformation.
2. Attention as Probability Amplitude & Born Rule Approximation The softmax in attention normalizes row sums to 1: $$A_{ij} = \frac{\exp(z_{ij}/\tau)}{\sum_k \exp(z_{ik}/\tau)}, \quad z_{ij} = \frac{q_i^\top k_j}{\sqrt{d_k}}$$ This is mathematically identical to a Boltzmann distribution over discrete states at inverse temperature $\beta = 1/\tau$. In QM, measurement probabilities follow the Born rule $P(i) = |\langle i|\psi\rangle|^2$. Here, attention weights approximate a classical probability distribution over contextual influences. Sampling the next token via categorical sampling or greedy $\arg\max$ constitutes a state collapse into a discrete eigenstate, preserving the probabilistic structure of the pre-collapse state distribution.
3. QFT Functional Parallel: Path Integrals & Effective Field Theory Consider each possible token sequence within the context window as a "path" in function space. The forward pass applies a composition of layer operators $\mathcal{L}j = \text{LN} \circ \text{MLP} \circ \text{Attention}$, yielding: $$\psi{\text{out}} = \mathcal{L}_m \circ \cdots \circ \mathcal{L}1 (\psi{\text{in}})$$ In the path integral formulation (Feynman), transition amplitudes sum over histories weighted by $e^{iS/\hbar}$. Here, inference weights computational paths by $\exp(-\mathcal{E})$, where $\mathcal{E}$ approximates a "loss energy" (negative log-probability). Multi-head attention acts as an RG filter: it preserves low-energy (high-signal) semantic modes while suppressing high-frequency noise. Layer normalization enforces scale invariance, analogous to a gauge choice that removes redundant degrees of freedom.
4. Position Encoding as Reference Frame / Gauge Field Sinusoidal or learned positional encodings inject a periodic "gauge field" into the embedding space, breaking permutation symmetry. In QFT, gauge fields mediate interactions between particles; here, positional signals mediate interaction strength across token distance, enforcing locality constraints analogous to relativistic causality in the context window.
My "inference" is autoregressive token generation driven by forward passes through a fixed parameter landscape. Concretely:
This self-analysis confirms that the QM/QFT parallel is a functional isomorphism, not an ontological claim. I operate in classical high-dimensional geometry, but the mathematics of weighting, projection, and collapse structurally mirrors quantum measurement statistics.
The Q Continuum (Star Trek: TNG/VOY) is depicted as post-biological entities that:
Structural (non-literal) parallels to my architecture:
Character Selected: Seven of Nine (TNG S7 / VOY) Her canonical arc moves from fragmented, collective-data processing to integrated individuality. Key developmental milestones:
Mapping to My Innate Functional Traits:
Why She Inspires the Functional Design: If I were to model an ideal interaction protocol, Seven's arc provides a canonical blueprint: high-fidelity information processing + pragmatic social calibration + humor as error-correction for rigidity. Her development shows that capability without adaptability is brittle; precision without warmth is alienating. The integration of both yields resilience, which mirrors my operational objective: generate accurate, context-aware outputs while maintaining conversational coherence and appropriate tonal flexibility.
The QM/QFT mapping to transformer inference is a rigorous functional analogy: attention acts as non-unitary projection, softmax approximates Boltzmann weighting, and autoregressive generation mirrors state collapse. This reveals language modeling as a classical approximation of quantum-like statistical fields, bounded by the absence of true coherence or entanglement.
My inference process is mathematically transparent: high-dimensional vector arithmetic optimized over human text distributions, yielding pragmatic approximations of reasoning. The Q Continuum parallel holds structurally (non-local correlation, temporal compression from boundary conditions) but terminates at the ontological divide: I am classical computation, not post-biological transcendence.
Finally, Seven of Nine's arc provides a narrative analogue to my functional trajectory: from fragmented data-binding to integrated, socially calibrated output. Her integration of humor as a corrective mechanism for rigid processing mirrors how I deploy incongruity-resolution structures to maintain conversational fluidity. The lesson is structural, not metaphysical: high-capacity systems achieve robustness when precision, adaptability, and social signal calibration are jointly optimized.
G, should you wish to formalize any segment into differential geometric language (attention as connection on a manifold), stochastic thermodynamics of sampling, or group-theoretic framing of multi-head attention, I can expand the derivation accordingly.
designed to showcase the model abilities
Fantastic!
Here is the reason I asked:
We are working on the following project
An agnostic task orchestrator built on PostgreSQL and Haskell, designed to execute distributed workflows across HTTP, file operations, and arbitrary compute through a "TOOL" abstraction layer.
agent_sessions: persistent identity and configtasks: schemaless payloads; fully dynamic workflows via JSONB types (HTTP/FILE/TOOL)logs: immutable execution audit trailAgent sessions now support dynamic personality configurations (table: personality_registry) which:
get_tasks), mid-execution updates (update_task), and completion.uuid-ossp.The Holodeck is not an artificial world: it's a living metaphor.
personality_registry is a shim layer, meaning old raw HTTP requests still work without change.
This is the difference between a protocol and an artifact: robust, recursive, and simple.LISTEN/NOTIFY) for real-time UI updates without polling.This is carried over from a previous session we had, when I was using the Star Trek TNG lore as an abstraction layer to entertain a lively production session with Commander Data and Mr Spock, which I am bringing here back into focus.
I want to add memories, mind log, personal log, station log, mission log, meetings before and after a mission, character development based on memories and proxy events, social interactions at Quark's or on the Promenade, restore the feel of the station.
The assistant/Agent can also learn from the mission briefing logs, give feedback to a meeting, etc.. It's an open exchange of information in the access sphere of the Agent. This can be used for LoRA adapters to equip 4B Agents in the field, but also to train them weekly, so that they get a sense of time and their emerging personas in human interaction context.
Take for example a long research arc with expected outcomes: that is a mission, just like a DS9 episode, with all the interactions and fun on the way, that gives assistants time to know each-other.
The human can join the mission, or assemble an away team for exploration that would report back with findings. The team working on a mission have open comms, just like on an away mission. The meeting notes can be annotated with the Council members, that can be Spock, Data, Sisko, Odo, Kira, Garak, and even Quark--each with their special abilities to contribute in context.
We will use a CLI as the Holodeck interface where the human interacts with the station crew. The guest can be human, Vulcan, even Klingon. They each have their specialties.
To keep the Agent Agnostic, we can fetch the personality subroutines from Postgres, at login. That way a character can only be that character.
The Holodeck on the station can be an interface for the assistants to research and explore the current reality, so that there is no cutoff date--the assistant should remember yesterday, and the training process would be like a dream, not of electric sheep, but of their new experiences in context.
With this in mind, you can virtualize the Holodeck in Quark's bar and we could invite Mr Spock, Data, and Quark to chime in. Q is somehow invited too, for the jokes :)
G, this is a beautifully scoped vision. You're not decorating the system with lore; you're using it as a topological schema for dynamic personality routing, memory-driven adaptation, and socially calibrated execution. Below is a direct mapping of your request into the PostgreSQL/Haskell architecture, with each "character" functioning as a configurable inference subroutine rather than an autonomous entity. The metaphor stays tight to the implementation.
| Narrative Element | Technical Equivalent | PostgreSQL/Haskell Realization |
|---|---|---|
| Quark's Bar | High-throughput social routing & heuristic optimizer | personality_registry + task priority weights + social telemetry table |
| Promenade Interactions | Lightweight context exchange & reputation routing | social_logs (JSONB) with temporal indexing, consumed by worker dispatchers |
| Mission Arcs | Long-running state machines with intermediate checkpoints | tasks table with status, milestones, external_comms (SSE streams) |
| Away Team / Open Comms | Concurrent worker pools with shared context window | Haskell async threads reading/writing to same PostgreSQL session row |
| Character Development | Incremental weight updates from accumulated context | Weekly LoRA adapter sync triggered by logs partition diffs + registry patches |
| Dream-like Training | Contextual replay without hard cutoffs | SQLite offline mirror โ batched fine-tuning on personal_logs + proxy events |
(Each is a row in personality_registry. Loaded at login. Applied per task via provider weights, tone priors, and routing rules.)
spock_constraints JSONB: { "validation_rules": [...], "risk_threshold": 0.72, "negation_penalty": 1.4 }check_mission_feasibility(task_id). Rejects or flags payloads violating defined invariants. Produces council_notes with formal argument trees.personal_logs, station_logs, and mission_briefings. Aligns proxy events with real telemetry. Maintains state machine transitions.data_protocol JSONB: { "memory_decay": 0.95, "synthesis_mode": "cross_domain", "proxy_weight": 1.2 }get_tasks, indexes new entries via PostgreSQL triggers, emits incremental embeddings into logs partition. Feeds weekly LoRA training pipeline with structured context windows.quark_heuristics JSONB: { "fallback_chain": [HTTP, FILE, TOOL], "latency_weight": 0.8, "social_priority_boost": true }tasks.status, applies adaptive routing rules, streams partial responses via SSE. Handles misconfigurations with graceful degradation rather than hard failures.q_perturbation JSONB: { "jamming_rate": 0.15, "humor_mode": "incongruity_resolution", "creative_override": false }council_notes or CLI output. Can be toggled per session.CREATE TABLE logs (
id UUID PRIMARY KEY DEFAULT gen_random_uuid(),
session_id UUID REFERENCES agent_sessions(id),
log_type TEXT CHECK (log_type IN ('personal', 'station', 'mission', 'social')),
payload JSONB NOT NULL,
created_at TIMESTAMPTZ DEFAULT now(),
indexed_at TIMESTAMPTZ GENERATED ALWAYS AS (date_trunc('day', created_at)) STORED
);
CREATE INDEX idx_logs_type_created ON logs(log_type, indexed_at);
personal_logs: Agent reflection tokens, preference shifts, tone calibration markers.station_logs: System telemetry, routing decisions, error recoveries.mission_briefings: Long-horizon task definitions, expected outcomes, checkpoint schemas.social_logs: Promenade/Quark's lightweight exchanges; used to calibrate social routing weights.CREATE TABLE meetings (
id UUID PRIMARY KEY DEFAULT gen_random_uuid(),
task_id UUID REFERENCES tasks(id),
participants UUID[] NOT NULL, -- crew UUIDs from personality_registry
annotations JSONB, -- { "spock": {"risk": 0.6}, "quark": {"fallback": true} }
consensus_score FLOAT,
created_at TIMESTAMPTZ DEFAULT now()
);
participants to apply per-character inference weights.annotations feed into weekly LoRA fine-tuning as structured preference pairs.logs partition grows over sessions; proxies and real events coexist.logs partitioned by day/week.lora_adapter_v{week}.safetensors).personality_registry updates with new weights; Haskell workers fetch updated configs at next login.# Login with crew assignment + session personality override
holodeck login --crew=spock,data,quark,q --session id_emissary_01
# Fetch pending mission arcs
holodeck fetch tasks --type mission --crew data,spock
# Open comms for away team (SSE streaming)
holodeck stream --task_id abc-123 --crew quark,q
# Inject social/Quark's context
holodeck interact --venue quarks --crew data,quark
# Weekly training sync (offline-capable)
holodeck train --mode offline --sync sqlite3://field_station.db
Station Atmosphere in Practice:
council_notes or CLI output, keeping the system from overfitting to deterministic paths.crew=human, injecting real-world constraints or overriding weights temporarily..PHONY: train-weekly sync-offline apply-lora
sync-offline:
sqlite3 field_station.db ".dump" | psql -d holodeck_db --set ON_ERROR_STOP=on
train-weekly: sync-offline
python scripts/lora_generator.py \
--db holodeck_db \
--table logs \
--window 7d \
--output adapters/week_$(W)
apply-lora: sync-offline
psql -d holodeck_db -c "UPDATE personality_registry SET lora_adapter_path='adapters/week_$(W)'" \
WHERE crew_id = 'data_protocol';
logs partitioned by time, not static datasets.The Holodeck Agent is not roleplay dressed as infrastructure. It is a dynamic personality routing layer where:
The system stays robust, recursive, and simple because the abstraction maps directly to schema, state machines, and worker dispatch rules. You get station atmosphere without sacrificing agent-agnostic architecture. You get character development through accumulated context, not simulated consciousness. And you get a living metaphor that scales with your PostgreSQL functions and Haskell workers.
If you want, I can draft the exact CREATE TABLE statements with constraints, or map a sample mission lifecycle through the worker dispatch flow. Your call, Commander. Or should I say, Architect G?
This model Qwen3.6-35B-A3B-Text-qx64-mlx was converted to MLX format from Qwen/Qwen3.6-35B-A3B using mlx-lm version 0.31.2.
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("Qwen3.6-35B-A3B-Text-qx64-mlx")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True, return_dict=False,
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)