Egypt_Historical7b

<div align="center">

Historical Egyptology 7B (GGUF)

Historical Egyptology 7B — a Mistral-7B-Instruct fine-tune infused with the grandeur, mystery, and wisdom of ancient Egypt.
Perfect for immersive historical roleplay, myth retellings, educational narratives, pharaonic decrees, scribe chronicles, and Nile-soaked storytelling.

</div>

---

COMPILING DATA WIP check tomm morn should be fully out

✨ Overview

This model was fine-tuned (LoRA r=64, alpha=64, 3 epochs, 860 cleaned examples) on historical Egyptology texts using Unsloth.
It excels at evocative, period-flavored prose — invoking gods (Ra, Anubis, Isis, Thoth), pharaohs, dynasties, mummification rites, pyramid construction, Nile mythology, and the atmosphere of temples and tombs.

Best uses:

• Deep historical fiction & alternate-history tales
• Educational explainers (mummification, Book of the Dead, Old/Middle/New Kingdom)
• Roleplay as pharaoh, high priest, scribe, tomb robber, explorer, deity…
• Creative local assistants with ancient-Egypt personality

Not optimized for:

• Strict modern factual accuracy (flavor > precision)
• Advanced math, coding, or technical reasoning
• Extremely long context without rope/extensions

Training snapshot (2026-02-05 run):

• Base: Mistral-7B-Instruct (~7.4B params)
• LoRA: 167,772,160 trainable params (2.26%)
• Dataset: 860 examples, max seq len 3072
• Epochs: 3 | Steps: 162 | Final loss: 1.7763
• Runtime: ~11.5 hours (1× GPU)

---

📜 Model Details

• Model name: Historical Egyptology 7B
• Base model: Mistral-7B-Instruct
• Fine-tuning: LoRA (merged via Unsloth)
• Parameters: ~7.4 billion
• Context length: 3072 native (tested up to 8192+ in llama.cpp)
• Language: English + ancient Egyptian stylistic terms
• License: MIT (subject to base model license)

---

🗿 Quantized Files

All files are from the same merged fine-tune checkpoint — only quantization level changes.

Quick picks:

• Most users → Q4_K_M or Q5_K_M (great balance on 6–8 GB cards)
• Tight hardware → Q3_K_M or Q4_K_S
• Maximum fidelity → Q8_0

---

🚀 Usage Examples (llama.cpp)

CLI – basic generation

./llama-cli \
  -m egypt-7b-v1.Q4_K_M.gguf \
  -ngl 35 \                        # adjust GPU layers (0 = CPU only)
  -c 4096 \
  --color \
  -p "You are a high priest of Amun-Ra in Karnak during the reign of Thutmose III. A young acolyte asks you to explain the sacred meaning of the benben stone and its connection to creation. Speak in solemn, evocative language." \
  -n 1024