Downloads · 30 days
43
14% of all-time downloads
gemma-mca-agent-gguf
moe2382/gemma-mca-agent-gguf
gemma-mca-agent-gguf is a machine learning model from moe2382. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Quantized versions of the Gemma 3 1B MCA SMS agent for fast CPU inference.
All-time downloads
308
Public
Repo size
1.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf1.7 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jan 21, 2026
- Updated
- Jan 21, 2026
- SHA
- 165d21a6
Base models
Model card
From the Hugging Face model README
Gemma MCA Agent - GGUF Quantized
Quantized versions of the Gemma 3 1B MCA SMS agent for fast CPU inference.
Models
| File | Size | Quantization | Notes |
|---|---|---|---|
| gemma-mca-agent-Q4_K_M.gguf | 769MB | Q4_K_M | Recommended - best quality/size balance |
| gemma-mca-agent-Q5_K_M.gguf | 812MB | Q5_K_M | Higher quality, slightly larger |
Usage with llama-cpp-python
from llama_cpp import Llama
llm = Llama(
model_path="./gemma-mca-agent-Q4_K_M.gguf",
n_ctx=2048,
n_threads=4,
)
prompt = "<start_of_turn>user\nI'm interested in funding<end_of_turn>\n<start_of_turn>model\n"
output = llm(prompt, max_tokens=256, temperature=0.7)
print(output["choices"][0]["text"])
Base Model
Fine-tuned from google/gemma-3-1b-it using LoRA on 3,300+ SMS conversation examples.
Original adapter: moe2382/gemma-mca-agent
- License
- apache-2.0
- Created
- Jan 21, 2026
- Updated
- Jan 21, 2026