Downloads ยท 30 days
320
3% of all-time downloads
ZERO-POINT-AI/Miss-MARTHA-hot-POCKET-edition-2B-OMNI
Miss-MARTHA-hot-POCKET-edition-2B-OMNI is a image-text-to-text model from ZERO-POINT-AI. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
license: apache-2.0 language: ========================================== basemodel: - 2B-Qwen3.5-Omni tags: - medical - art - music - biology license: apache-2.0 newversion: ZERO-POINT-INTELLIGENCE-LTD/MARTHA-hot-POCKโฆ
Downloads ยท 30 days
320
3% of all-time downloads
All-time downloads
12.6K
Public
Parameters
2.3B
16.7 GB on disk
Likes
24
Public
Click a slice to open those files.
.gguf12.1 GB ยท 73%
From the Hugging Face model README
base_model:
By Zero Point Intelligence , Dundee, Scotland.
Omni model fine-tuned from Qwen/Qwen3.5-2B Full fine-tune + LoRA, Supports image-text-to-text generation.
license: apache-2.0 library_name: transformers pipeline_tag: image-text-to-text tags:
Vision + Language AI โ sees images, reads text, answers everything.
Built by Zero Point Intelligence Ltd, Dundee, Scotland ๐ด๓ ง๓ ข๓ ณ๓ ฃ๓ ด๓ ฟ
This is a 2B parameter AI model that can:
Step 1: Install Ollama โ it's a free app that runs AI models locally.
Step 2: Open PowerShell (search "PowerShell" in Start menu) and paste:
mkdir C:\models\martha-2b -Force
cd C:\models\martha-2b
# Download the brain
Invoke-WebRequest -Uri "https://huggingface.co/ZERO-POINT-INTELLIGENCE-LTD/MARTHA-9B-Qwen3.5-Omni/resolve/main/MARTHA-9B-Q4_K_M.gguf" -OutFile "MARTHA-9B-Q4_K_M.gguf"
# Download the eyes (for image understanding)
Invoke-WebRequest -Uri "https://huggingface.co/ZERO-POINT-INTELLIGENCE-LTD/MARTHA-9B-Qwen3.5-Omni/resolve/main/mmproj-f16.gguf" -OutFile "mmproj-f16.gguf"
Step 3: Create a file called Modelfile (no extension) with this content:
FROM ./MARTHA-9B-Q4_K_M.gguf
PROJECTOR ./mmproj-f16.gguf
SYSTEM """You are MARTHA-2B, a vision-language AI built by Zero Point Intelligence Ltd."""
PARAMETER temperature 0.7
PARAMETER num_ctx 4096
PARAMETER stop "<|im_end|>"
PARAMETER stop "<|im_start|>"
Step 4: In PowerShell, run:
ollama create martha-2b -f Modelfile
ollama run martha-2b
You're now chatting with MARTHA. Type a message and hit Enter.
mkdir -p ~/models/martha-2b && cd ~/models/martha-9b
# Download brain + eyes
wget "https://huggingface.co/ZERO-POINT-INTELLIGENCE-LTD/MARTHA-9B-Qwen3.5-Omni/resolve/main/MARTHA-9B-Q4_K_M.gguf"
wget "https://huggingface.co/ZERO-POINT-INTELLIGENCE-LTD/MARTHA-9B-Qwen3.5-Omni/resolve/main/mmproj-f16.gguf"
# Create Modelfile
cat > Modelfile << 'EOF'
FROM ./MARTHA-2B-Q4_K_M.gguf
PROJECTOR ./mmproj-f16.gguf
SYSTEM """You are MARTHA-2B, a vision-language AI built by Zero Point Intelligence Ltd."""
PARAMETER temperature 0.7
PARAMETER num_ctx 4096
PARAMETER stop "<|im_end|>"
PARAMETER stop "<|im_start|>"
EOF
# Create and run
ollama create martha-2b -f Modelfile
ollama run martha-2b
MARTHA can see images when you use the mmproj-f16.gguf file alongside the main GGUF.
docker run -d -p 3000:8080 -v open-webui:/app/backend/data -e OLLAMA_BASE_URL=http://host.docker.internal:11434 --name open-webui --restart always ghcr.io/open-webui/open-webui:main
martha-9b from the model dropdownllama-server -m MARTHA-2B-Q4_K_M.gguf --mmproj mmproj-f16.gguf -ngl 99 --port 8080
Then send requests to http://localhost:8080/v1/chat/completions
| File | What It Does | Size |
|---|---|---|
MARTHA-9B-Q8_0.gguf | Highest quality text model | ~9.5 GB |
MARTHA-9B-Q6_K.gguf | High quality, smaller | ~7.4 GB |
MARTHA-9B-Q5_K_M.gguf | Good balance of quality/size | ~6.5 GB |
MARTHA-9B-Q4_K_M.gguf | Smallest, still good | ~5.5 GB |
mmproj-f16.gguf | Vision projector (the eyes) | ~900 MB |
MODELFILE_* | Ready-made configs for Ollama | tiny |
| Term | What It Means |
|---|---|
| GGUF | A file format for AI models. Like .mp3 is for music, .gguf is for AI brains. |
| Quantization (Q4, Q5, Q8) | Compression level. Lower number = smaller file but slightly less smart. Q4 is like JPEG, Q8 is like PNG. |
| mmproj | The vision projector โ a separate file that gives the model eyes. Without it, the model can only read text. |
| Ollama | Free software that runs AI models on your computer. Think of it as a media player, but for AI. |
| VRAM | Your graphics card's memory. More VRAM = bigger models you can run. Check yours with nvidia-smi in terminal. |
| Modelfile | A config file that tells Ollama how to set up the model. Like a recipe card. |
| Open WebUI | A web interface that makes chatting with local AI look like a web chat app. Runs in Docker. |
| Model | Minimum VRAM | Recommended VRAM | Runs On |
|---|---|---|---|
| Q4_K_M | 4 GB | 6 GB | Most gaming PCs, M1+ Macs |
| Q5_K_M | 5 GB | 8 GB | RTX 3060+, M1+ Macs |
| Q6_K | 6 GB | 8 GB | RTX 3060+, M2+ Macs |
| Q8_0 | 8 GB | 12 GB | RTX 3070+, M2 Pro+ Macs |
No GPU? MARTHA runs on CPU too โ just slower. Every modern computer can run Q4_K_M.
| Model | Parameters | Best For |
|---|---|---|
| MARTHA-0.8B | 0.8B | Phones, Raspberry Pi, embedded |
| MARTHA-2B | 2B | Laptops, light desktops |
| MARTHA-4B | 4B | Gaming PCs, most desktops |
| MARTHA-9B | 9B | RTX 3080+, workstations |
| MARTHA-27B | 27B | Multi-GPU, cloud |
| MARTHA-73B | 73B | Server-grade |
| MARTHA-120B | 120B (5.1B active) | Data centre |
"ollama: command not found" โ Install Ollama from https://ollama.com
"model not found" โ Make sure you ran ollama create with the Modelfile first
"out of memory" โ Try a smaller quant (Q4 instead of Q8) or close other apps
"images aren't working" โ Make sure you downloaded mmproj-f16.gguf AND used PROJECTOR in your Modelfile
"slow generation" โ Your GPU might not be detected. Run nvidia-smi to check. If no GPU, it runs on CPU which is slower but still works.
Apache 2.0 โ fork it, fine-tune it, sell it, do whatever. Just keep the attribution.
Copyright 2026 Zero Point Intelligence Ltd. Built in Dundee, Scotland.
https://zeropointai.uk | https://huggingface.co/ZERO-POINT-INTELLIGENCE-LTD