Downloads · 30 days
159
11% of all-time downloads
EryriLabs/Caelum-G4-38B-A12.5B-GGUF
Caelum-G4-38B-A12.5B-GGUF is a text generation model from EryriLabs. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as apache-2.0.
CPU/RAM quantizations of the four-expert Caelum-G4-38B-A12.5B sparse MoE.
Downloads · 30 days
159
11% of all-time downloads
All-time downloads
1.4K
Public
Repo size
153 GB
Likes
2
Public
Click a slice to open those files.
.gguf153 GB · 100%
From the Hugging Face model README
CPU/RAM quantizations of the four-expert Caelum-G4-38B-A12.5B sparse MoE.
Caelum contains 38.01B total parameters and activates approximately 12.53B per token through top-1 routing. Sparse activation can reduce compute, but all four experts remain in the GGUF file and contribute to storage and memory-mapping requirements.
| Quantization | Positioning | Validation state |
|---|---|---|
| Q4_K_M | Recommended default | 23.16 GB; llama.cpp smoke and complete AirGapBench v1 matrix passed |
| Q5_K_M | Recommended quality option | 27.04 GB; llama.cpp functional smoke passed |
| Q6_K | Higher fidelity | Planned; publish only after smoke and regression tests |
| Q8_0 | Near-lossless reference | Planned; large and usually unnecessary for ordinary use |
| Q3_K_M | Low-RAM compromise | Planned; must pass quality and routing-regression tests |
| IQ2_M | Smallest experimental release | Planned; highest quality risk and not the recommended first download |
Q4_K_M is the sensible headline quant. Keep IQ2_M available for machines that otherwise could not run the model, but label it experimental rather than promoting it as equivalent quality.
Use a recent llama.cpp build with Gemma 4 Unified MoE support.
llama-cli \
-hf EryriLabs/Caelum-G4-38B-A12.5B-GGUF:Q4_K_M \
-cnv \
-c 2048 \
-n 512 \
--temp 0
OpenAI-compatible local server:
llama-server \
-hf EryriLabs/Caelum-G4-38B-A12.5B-GGUF:Q4_K_M \
-c 2048 \
--host 127.0.0.1 \
--port 8080
The validated artifacts used stock llama.cpp commit:
69bf6437914596fbbc4caf09a7ac16f2acdd1a94
The Q4_K_M build scored 20/28 (71.43%) on frozen AirGapBench v1, compared with 18/28 (64.29%) for the strongest dense donor and 17/28 (60.71%) for the official Gemma 4 12B IT base. All models used Q4_K_M, CPU-only llama.cpp, context 2,048, temperature 0, a 256-token output limit, and thinking disabled.
This is a small internal selection suite, not an external leaderboard. See the main model card for the complete category matrix, source lineage, limitations, and reproducibility details.
--no-repack, one 256-token slot, and prompts spanning the four routing domains. A physical 32 GB machine has not yet been validated.Apache-2.0, subject to the licenses and notices of the main Caelum model and all its source checkpoints. Caelum is an unofficial derivative and is not endorsed by Google, the Gemma team, or the donor authors.