AlterEgo-GGUF

<div align="center">

🧠 AlterEgo-373M - GGUF

GGUF builds of a 373M language model designed, trained, and served entirely from scratch.

</div>

---

GGUF quantizations of jbomdev/AlterEgo, a 373M-parameter decoder-only model built from the ground up: architecture, training, tokenizer, and inference all written from scratch. For the full story, including architecture, training curves, hyperparameters, and benchmarks, see the main model card.

Run it with Ollama (one command)

ollama run hf.co/jbomdev/AlterEgo-GGUF:Q8_0

Swap the tag for any quant in the table (:Q4_K_M, :F16). The ChatML template, stop tokens, and sampling defaults are applied automatically from the GGUF metadata and the params file in this repo.

Run it with llama.cpp

llama-cli -hf jbomdev/AlterEgo-GGUF:Q8_0 -p "Tell me about the ocean."

Quantizations

AlterEgo is small enough that Q8_0 (or even F16) runs comfortably on any laptop, and at this scale those preserve quality better than aggressive 4-bit quantization. Reach for Q4_K_M only if you want the smallest possible download.

Recommended generation settings

These are the defaults AlterEgo was tuned and served with in LLME:

Chat format

AlterEgo uses ChatML, and stops on <|im_end|> or <|endoftext|>:

<|im_start|>system
{system prompt}<|im_end|>
<|im_start|>user
{message}<|im_end|>
<|im_start|>assistant

Limitations

A 373M model on a modest token budget behaves like one: it can be factually wrong, repeat itself, and lose coherence on long prompts. English only. Not safety- or preference-tuned. See the main model card for details.

License

Apache 2.0, same as the base model.