Chrismas-Spirit7b

<!-- GHOSTAI • CHRISTMAS SPIRIT GGUF (7B) Professional Hugging Face README for a GGUF release. --> <p align="center"> <img src="https://capsule-render.vercel.app/api?type=waving&color=0:0b1d12,50:8b0000,100:0b1d12&height=170&section=header&text=GHOSTAI%20%E2%80%94%20CHRISTMAS%20SPIRIT%20GGUF%20(7B)&fontSize=40&fontColor=F7F7F7&animation=twinkling" /> </p> <p align="center"> <img alt="Format" src="https://img.shields.io/badge/Format-GGUF-0B1D12?style=for-the-badge"> <img alt="Runtime" src="https://img.shields.io/badge/Runtime-llama.cpp-14532D?style=for-the-badge"> <img alt="Model Size" src="https://img.shields.io/badge/Model-7B-1F6FEB?style=for-the-badge"> <img alt="Theme" src="https://img.shields.io/badge/Theme-Christmas%20Spirit-8B0000?style=for-the-badge"> <a href="https://www.linkedin.com/in/ccengineering/"> <img alt="LinkedIn" src="https://img.shields.io/badge/LinkedIn-ccengineering-0A66C2?style=for-the-badge&logo=linkedin&logoColor=white"> </a> </p> <p align="center"> <strong>GHOSTAI — Christmas Spirit GGUF (7B)</strong><br/> A holiday-forward 7B model tuned for cozy storytelling, cheerful roleplay, and warm seasonal vibes — shipped in <strong>GGUF</strong> for the <strong>llama.cpp</strong> ecosystem.<br/> _{Quantized builds included for most users. An optional F16 GGUF is included for maximum fidelity.} </p>

---

Overview

GHOSTAI: Christmas Spirit is designed to produce cozy, wholesome, and festive outputs: winter scenes, gift-giving stories, cheerful dialog, holiday recipes, and family-friendly roleplay.

This repository provides multiple GGUF variants, so you can choose the best balance of quality, speed, and memory usage for your hardware.

You can run it:

• CPU-only
• With GPU offload (CUDA / Metal / Vulkan builds of llama.cpp)

Quant choice is independent of CPU vs GPU; GPU offload is controlled by runtime flags (example: -ngl).

---

Files (this release)

Sizes below reflect the exported files in this repo.

RAM notes (rough):

• Assumes ~4k context and typical llama.cpp overhead.
• For 8k context, plan +1–2 GB extra (or more depending on runner/settings).
• GPU offload can shift some load to VRAM; you still need system RAM.

---

Recommended downloads

• Best default: christmas_mistral_v1.Q4_K_M.gguf
• Higher quality: Q5_K_M, Q6_K, Q8_0
• Low RAM: Q3_K_S, Q2_K
• Ultra-small / experimental: TQ1_0 (expect noticeable quality loss)
• Maximum fidelity: f16 (largest)

---

Quickstart (llama.cpp)

CPU-only (simple + portable)

./llama-cli \
  -m christmas_mistral_v1.Q4_K_M.gguf \
  -ngl 0 \
  -c 4096 \
  -p "You are GHOSTAI Christmas Spirit. Write a cozy winter story set in a small town, with a warm ending."