Downloads · 30 days
0
nexus-core
Uspallata22/nexus-core
nexus-core is a text generation model from Uspallata22. Use it when you need the model to write or continue text. It is set up for nexus-core. The card lists the license as apache-2.0.
Nexus-Core represents a paradigm shift in bare-metal Edge AI orchestration. By collapsing the Python GIL bottleneck through a zero-copy Rust core, eliminating PagedAttention VRAM fragmentation via reference-counted Co…
Access
Public
Updated Apr 25, 2026
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.nexus3.4 KB · 43%
At a glance
- Task
- Text Generation
- Library
- nexus-core
- License
- apache-2.0
- Access
- Public
- Created
- Apr 25, 2026
- Updated
- Apr 25, 2026
- SHA
- b9e31bbf
Try a prompt
Base models
Model card
From the Hugging Face model README
Nexus-Core × Gemma 4 (8B-IT)
🚀 Enterprise Integration & Strategic Acquisition
Nexus-Core represents a paradigm shift in bare-metal Edge AI orchestration. By collapsing the Python GIL bottleneck through a zero-copy Rust core, eliminating PagedAttention VRAM fragmentation via reference-counted Copy-on-Write KV blocks, and enforcing deterministic semantic routing through a Zero-Trust MCP gatekeeper, the architecture delivers production-grade reliability where conventional Python-first stacks degrade under load. The full intellectual property — covering the Codata substrate, the continuous-batching scheduler, the lock-free hardware profiler, and the cognitive reliability layer — is available for B2B licensing, enterprise deployment partnerships, or strategic acquisition.
- GitHub Repository: rupertin123/nexus-core
- Lead Architect: Lucas Aloisio
- Email for Inquiries: [email protected]
- LinkedIn: Connect on LinkedIn
Nexus-Core wraps google/gemma-4-8b-it in a deterministic, Rust-backed
orchestrator designed for the Edge: PagedAttention with Copy-on-Write
prefix sharing, a Zero-Trust MCP gatekeeper, lock-free hardware
telemetry, and a continuous-batching scheduler that survives
oversubscribed workloads without OOM. The repository ships
pre-compiled wheels for Linux (x86_64 / aarch64), macOS (x86_64 /
aarch64), and Windows (x86_64); end users never touch a Rust toolchain.
Recommended GGUF Quantizations for Nexus-Core
| Quantization | Use Case | VRAM (PagedAttention Est.) | Target Hardware |
|---|---|---|---|
Q4_K_M | Balanced laptop / on-device assistant; best size-quality trade-off for interactive agents. | ~5.5 GB at 32k ctx, ~7 GB at 128k ctx with CoW prefix sharing. | Apple M-series (8–16 GB unified memory), NVIDIA RTX 4060 / 4070 mobile, ROCm 7900M. |
Q8_0 | Server-side accuracy; near-FP16 fidelity for evaluation, distillation, or compliance-grade inference. | ~9 GB at 32k ctx, ~11 GB at 128k ctx. | NVIDIA RTX 4090 / 5090, A100 40 GB, H100 PCIe slice. |
AWQ | Pure GPU throughput; activation-aware 4-bit weights for high-QPS deployments behind the continuous-batching scheduler. | ~6 GB at 32k ctx with batched KV-cache reuse. | NVIDIA L4 / L40S, RTX 5080, Jetson AGX Orin 64 GB. |
Contact & Community
Architectural feedback, open-source collaboration, and B2B / VC inquiries are all welcome. The fastest way to start a conversation is a direct message on either of the channels below.
- Email: [email protected]
- LinkedIn: Lucas Aloisio
- Task
- Text Generation
- Library
- nexus-core
- License
- apache-2.0
- Created
- Apr 25, 2026
- Updated
- Apr 25, 2026