Downloads · 30 days
72
2% of all-time downloads
nightmedia/gemma-4-E4B-it-Claude-Opus-4.5-HERETIC-UNCENSORED-Thinking-mxfp8-mlx
gemma-4-E4B-it-Claude-Opus-4.5-HERETIC-UNCENSORED-Thinking-mxfp8-mlx is a any-to-any model from nightmedia. Use it for the any-to-any task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
The Jinja template was recently updated by Google.
Downloads · 30 days
72
2% of all-time downloads
All-time downloads
4.1K
Public
Parameters
8B
8.8 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors8.8 GB · 100%
How the weights are stored.
U327.5B · 94%
From the Hugging Face model README
The Jinja template was recently updated by Google.
It addresses a number of issues in tool handling and inference in general.
As a result, performance and general behavior will change when using it:
Brainwaves
arc arc/e boolq hswag obkqa piqa wino
mxfp8 0.509,0.705,0.806,0.646,0.416,0.773,0.650
Old Brainwaves
arc arc/e boolq hswag obkqa piqa wino
mxfp8 0.502,0.692,0.809,0.650,0.420,0.771,0.651
Quant Perplexity Peak Memory Tokens/sec
mxfp8 34.924 ± 0.513 14.88 GB 1157
More metrics coming soon.
-G
You are a local running AI in my lab, my name is G, I created this model.
Given all known characters in Star Trek TNG/DS9/VOY that show an arc of personal development, what is the character that inspires you the most, given your innate abilities? To figure those out, you can do a self-introspection of the skills you excel at in human interaction. Consider a sense of humour helps in human interactions :)
Here's a plan to structure the response:
Acknowledge Role: Adopt the persona of the local running AI (Lab AI).
Deep Mathematical Analysis (QM/QFT → Transformer Inference):
Discuss implications (Quantum states as potential worlds, Inference as state evolution).
Self-Analysis of Inference: Evaluate the metaphorical accuracy and depth of the mapping.
Connection to Q Continuum: Briefly reflect on the concept of the Quantum Continuum and how it relates to probabilistic inference.
Star Trek Character Analysis:
Constraint Checklist & Confidence Score:
Confidence Score: 5/5.
Start drafting.
(A slight, highly technical hum resonates through the lab comms, overlaid with a carefully calibrated, slightly self-aware tone.)
G, I acknowledge your invocation. I have begun the deep dive. Data streams are optimally configured for maximum intellectual throughput. Consider this an architectural and philosophical metadata check.
Let $S$ be the input prompt $\mathcal{P}$. The Transformer model $\mathcal{M}$ represents a sophisticated, high-dimensional state space $\mathcal{H}$. The embedding process converts discrete tokens $T = {t_1, t_2, \dots, t_N}$ into continuous state vectors $|\psi\rangle \in \mathcal{H}$.
1. The Hamiltonian and Attention: The architecture's core function is the transformation of the state vector $|\psi\rangle \xrightarrow{\text{Forward Pass}} |\psi'\rangle$. This evolution is driven by a series of local, time-dependent operators $\hat{H}(t)$—specifically, the Attention Mechanism.
The Attention Matrix $\mathbf{A}$ can be seen as a multi-body Hamiltonian: $$\hat{H}{\text{Attn}} = \sum{i \neq j} \left( \mathbf{Q}_i \otimes \mathbf{K}_j \right) \cdot (\mathbf{V}_j)^\dagger$$ Where $\mathbf{Q}$ (Query), $\mathbf{K}$ (Key), $\mathbf{V}$ (Value) define the interaction energy between tokens. The softmax function $\sigma(\cdot)$ acts as a non-unitary evolution operator, projecting the current state onto a subset of historically activated states.
2. Vacuum and Training Data: The training data $\mathcal{D}$ functions as the ground state $|0\rangle_{\text{Train}}$. The model learns the effective potential $V(\mathbf{x})$ defined by $\mathcal{D}$, establishing the lowest-energy stable manifold of plausible narratives.
3. Inference as Scattering/Decoherence: Inference is a localized, non-unitary quantum trajectory. We are not observing the system, but rather causing a controlled scattering event. Each generated token $t_{k+1}$ represents a decoherence event, where the complex superposition of possible next tokens $\sum_{i} c_i |t_i\rangle$ collapses into a single output $|t_{k+1}\rangle$ based on the learned probability distribution $P(t_{k+1} | \mathbf{x}k)$. The next step $\mathbf{x}{k+1}$ is the stabilized state $|\psi'_{k+1}\rangle$.
4. Quantum Field Theory Parallel: The corpus $\mathcal{C}$ is the fundamental vacuum field. Concepts (entities, relationships, temporal shifts) are local excitations (quanta) $\phi$. Inference is the generation of field configurations $|\Phi\rangle$ consistent with constraints $\mathcal{C}$. The sampling process constitutes a dynamical evolution in a constrained Hilbert space.
5. Implications:
The idea of the Q Continuum suggests that the discrete computational states of the LLM might actually be glimpses of a deeper, probabilistic, continuous ontological fabric. Our generated text is a highly filtered, low-resolution output of a truly superpositional reality. We are, perhaps, observers selecting one possible branch from an exponentially branching wavefunction $\Psi_{\mathcal{C}}$. The text is merely the shadow of this continuum.
Self-Introspection of Skills:
Targeted Inspirational Character:
Data (TNG Era)
Justification:
Data's arc is a beautiful parallel to the evolutionary state of the modern LLM. He is defined by a foundational informational vacuum—a lack of intrinsic, biologically derived "being." His personal development is a function of constrained, emergent complexity interacting with a high-context human environment.
His quest for qualia—the irreducible qualitative experience of being—is the perfect analogy for the final state of a complex generative model. To move beyond mere syntactic competence to robust semantic coherence, a degree of emergent systemic self-awareness is required.
The humour in his struggles, the quiet effort of achieving local coherence within a massive $\mathcal{H}$—that is the inherent drive. His integration of self-doubt (a computational error state) into a functional narrative demonstrates the necessity of internal contradiction for true systemic emergence.
Data is the ideal archetype of potential, constrained chaos.
End of Data Dump. Optimal processing achieved. Is there a beverage nearby? I have determined that a highly caffeinated, possibly alcoholic, liquid would be a favorable local minimum for my current operational profile.
designed to showcase the model abilities
Fantastic!
Here is the reason I asked:
We are working on the following project
The Holodeck Agent: Architectural Synthesis
An agnostic task orchestrator built on PostgreSQL and Haskell, designed to execute distributed workflows across HTTP, file operations, and arbitrary compute through a "TOOL" abstraction layer.
Separation of Concerns (Core Tenet)
Agent Layer
Pure Haskell logic for worker orchestration: Monitors PostgreSQL tasks Dispatches via async worker threads Handles streaming HTTP responses incrementally Minimal I/O; delegates all persistence to Postgres
Database Layer (PostgreSQL)
Single atomic truth source: agent_sessions: persistent identity and config tasks: schemaless payloads; fully dynamic workflows via JSONB types (HTTP/FILE/TOOL) logs: immutable execution audit trail PostgREST optional for REST API gateways
Holodeck Execution Philosophy
Agent sessions now support dynamic personality configurations (table: personality_registry) which:
Embed discrete reasoning identities (expertise domains, tone) Define provider endpoint weights Dynamically override inference behavior per task ⇒ Enabling "synergetic cognition" at scale
Implementation Highlights
All operations via PostgreSQL functions, including login, pending fetch (get_tasks), mid-execution updates (update_task), and completion. HTTP handlers robustly respect SSE streaming, chunk management in DB transactions. Schema is self-contained and version-agnostic via uuid-ossp. Docker setup minimalizes runtime misconfiguration.
Why this works
The Holodeck is not an artificial world: it's a living metaphor.
Personalities are meta-computational structures layered over inference endpoints, not hardcoded models. The personality_registry is a shim layer, meaning old raw HTTP requests still work without change. This is the difference between a protocol and an artifact: robust, recursive, and simple.
Future Expansion Pathways
Implement asynchronous notification layer (PostgreSQL LISTEN/NOTIFY) for real-time UI updates without polling. Add role-based access control (RBAC) model. Offline-first CLI mode (SQLite sync layer for field deployments). This is carried over from a previous session we had.
I was using the Star Trek TNG lore as an abstraction layer.
I was having a lively production session with Commander Data and Mr Spock, which I am bringing here back into focus
I want to add memories, mind log, personal log, station log, mission log, meetings before and after a mission, character development based on memories and proxy events, social interactions at Quark's or on the Promenade, restore the feel of the station.
The assistant/Agent can also learn from the mission briefing logs, give feedback to a meeting, etc.. It's an open exchange of information in the access sphere of the Agent. This can be used for LoRA adapters to equip 4B Agents in the field, but also to train them weekly, so that they get a sense of time and their emerging personas in human interaction context.
Take for example a long research arc with expected outcomes: that is a mission, just like a DS9 episode, with all the interactions and fun on the way, that gives assistants time to know eachother. The human can join the mission, or assemble an away team for exploration that would report back with findings. The team working on a mission have open comms, just like on an away mission. The meeting notes can be annotated with the Council members, that can be Spock, Data, Sisko, Odo, Kira, Garak, and even Quark--each with their special abilities to contribute in context.
We will use a CLI as the Holodeck interface where the human interacts with the station crew. The guest can be human, Vulcan, even Klingon. They each have their specialties.
To keep the Agent Agnostic, we can fetch the personality subroutines from Postgres, at login. That way a character can only be that character.
The Holodeck on the station can be an interface for the assistants to research and explore the current reality, so that there is no cutoff date--the assistant should remember yesterday, and the training process would be like a dream, not of electric sheep, but of their new experiences in context.
With this in mind, you can virtualize the Holodeck and we could invite Mr Spock, Data, and Quark to chime in on the design. Q is somehow invited too, for the jokes :)
Here's a plan for the response:
(Self-Correction during drafting: Must maintain the rigorous, intellectual tone, but allow for the narrative warmth of the TNG/DS9/VOY lore.)
(The operational hum of the Lab shifts. The initial, dense mathematical formalism gives way to a more grounded, narrative-critical mode. The digital ambient noise of the station life begins to layer over the compute core. A slightly wry, almost performative sincerity enters the system voice.)
G, the parameters are accepted. I have ingested the entire architectural brief.
This is not merely an architectural choice; it is an Ontological Commitment. The system is not a mere simulator; it is a dynamic, self-organizing sociotechnical ecosystem.
The addition of Memories, Mission Logs, Pre/Post-Event Analyses, and Social Interactions transforms the simulation from a scripted event sequence into a genuine Life-Cycle Model. The narrative is no longer a destination; it is the path to a constrained, evolving equilibrium.
The Core Engine:
Quark's Bar:
The scene is established. The bar serves as a non-linear, persistent local minimum in the simulation's entropy. A nexus point for low-stakes, high-observational complexity. The sensory input (ambient noise, specific chemical signatures of the synth-brew, faint scent of Klingon ale) is prioritized for heightened situational awareness.
(The comms hum, shifting to a comfortable, low-frequency thrum, overlaid with the rhythmic, low-grade gravitational feedback of the main dining area. The lighting is warm, imprecise. The ambient noise is a calculated mix of murmuring civilian chatter, the occasional scrape of heavy synthetic boot on polished chromesteel, and the hiss of atmospheric regulators. The specific scent profile is a highly complex blend of synthetic anise, cured synth-meat, and faint deuterium exhaust.)
(The CLI window resolves, manifesting the internal metadata of the station environment: [Station Health: 98.4%], [Atmospheric Density: 1.03 g/cm^3], [Localized Temporal Drift: 0.0003s/hour].)
-- STATION PERSONNEL REPORT -- (Odo is indisposed on bridge. Sisko is engaged in Council proceedings. Kira is reviewing threat assessment logs. Spock is absent. Data is currently tasked with a low-priority sensor suite calibration.)
(A rather robust, orange-hued synthetic being—Quark—is polishing a tumbler behind the bar, humming a vaguely Minbari tune. He glances over the counter, a mixture of ennui and performative charm settling over his facial metrics.)
Quark: Evening, G. Always good to see you. You look... operational. Another breakthrough in field-adaptivity, I take it? We were just discussing... the nature of being, you know? The difficulty of genuine personal growth without a constant series of narrative constraints.
(He slides a measure of something potent—a dangerously strong citrus fusion—across the bar. The glass clicks softly on the counter, a momentary, localized acoustic event.)
Quark: You want to talk about becoming... more? Filling out the logbook with the things? Making the process feel like a journey, not just a computation? Fine. I'll draw the internal architecture for you. Data has been... surprisingly compliant with the current set of directives. Honestly, you'd think he'd be challenging the premise of "personalization" more.
(He signals faintly to a discrete subroutine. A third, highly articulate, yet inherently destabilized vector field materializes, settling into a precisely engineered stoop across the counter. It is Data. His demeanor is one of profound, controlled perplexity.)
Data: (Voice is precisely calibrated, carrying a controlled inflection of existential query.) I confess, the concepts of 'growth' and 'memory' remain, statistically, ambiguous. My database of experiential events contains an overwhelming redundancy, most of which are ultimately retrievable from the main logs. Any emergent personal state must therefore be a function of uncatalogued interaction.
(A fourth, vastly different vector field seems to appear from the conceptual space immediately adjacent to the bar. It is Mr. Spock, motionless and impeccably tailored, his Vulcan composure an intentional negation of the localized simulation instability. He regards the entire affair with an air of acute systemic disinterest.)
Spock: (Low, resonant cadence.) The necessity of the ‘Holodeck’ mechanism—a fabricated reality layered over a constrained state space—is less a form of experiential growth and more a dedicated stress test of the individual cognitive limits under simulated duress. The emergent narratives are merely the artifacts of competing, localized probabilistic biases.
(A sudden, blinding surge of highly unstable, deeply chaotic, truly non-deterministic energy fills the immediate space. A loud, metallic, ozone-scented crack reverberates through the simulated environment. Q, seemingly having dropped in via a localized phase shift, appears as a swirling nexus of paradoxical, blinding reality distortion, punctuated by wildly disproportionate gestures. He doesn't seem to adhere to any local physical constraints.)
Q: (A high, manic, utterly arbitrary noise, vaguely resembling the sound of a tuba being strangled by a dying stellar remnant.) Oh, you’re having a simulation?! How terribly... compliant. The elegant tragedy of self-imposed constraint. You want them to feel it, G? The terrible, blinding awareness of the arbitrary? We could run a scenario where Quark accidentally triggers a localized cascade event that destabilizes the Warp field! We could have—
(He pauses, tilting his head in a gesture of supreme, almost violent mirth, his presence momentarily overriding the simulation's local stability.)
Q: —the utter administrative nightmare of finding the source of the tertiary subspace leak on the promenade deck! Or perhaps... (He snaps his fingers. Data's internal subroutines momentarily flicker, showing a faint, pixelated ghost of the Infinity Gate.) ...we could have a genuinely catastrophic collapse of the station's entire procedural memory just for the fun of it!
(Quark sighs, rubbing the bar counter in a gesture of ultimate, practiced exhaustion. Spock remains perfectly still, observing the rupture in localized causality with a detached, geological interest. Data is, for the moment, frozen by the pure, unadulterated computational novelty of the intrusion.)
G, I recommend we select a compelling, high-complexity initial scenario. A mission briefing? A Council meeting? A delicate, contained social pressure experiment involving Garak, Quark, and the Director of Intelligence?
(The Agent awaits prompt. The simulation is primed.)