Downloads · 30 days
121
11% of all-time downloads
laabamone/laabam-ai-3b-v1-gguf
laabam-ai-3b-v1-gguf is a text generation model from laabamone. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
Downloads · 30 days
121
11% of all-time downloads
All-time downloads
1.1K
Public
Repo size
16.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf8.1 GB · 100%
From the Hugging Face model README
Run Agni on your laptop, phone, or edge device
Full Model (Safetensors) • LoRA Adapter • Website
</div>| File | Quantization | Size | Description | Recommendation |
|---|---|---|---|---|
laabam-ai-3b-v1-Q4_K_M.gguf | Q4_K_M | 1.8 GB | 4-bit quantized (medium) | ✅ Recommended — best balance |
laabam-ai-3b-v1-bf16.gguf | BF16 | 5.8 GB | Full precision | Maximum quality, needs 8GB+ RAM |
# Download the model
huggingface-cli download laabamone/laabam-ai-3b-v1-gguf \
laabam-ai-3b-v1-Q4_K_M.gguf --local-dir .
# Create a Modelfile
cat > Modelfile << 'EOF'
FROM ./laabam-ai-3b-v1-Q4_K_M.gguf
TEMPLATE """<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
"""
SYSTEM "You are Agni, a helpful multilingual AI assistant created by Laabam One Business Solutions. You support Hindi, Tamil, Telugu, Kannada, and English."
PARAMETER temperature 0.7
PARAMETER top_p 0.9
PARAMETER stop "<|im_end|>"
EOF
# Create and run
ollama create agni-lite -f Modelfile
ollama run agni-lite "Write hello world in Python"
./llama-cli -m laabam-ai-3b-v1-Q4_K_M.gguf \
-p "You are Agni, a helpful assistant.\n\nUser: Tell me about Tamil Nadu.\nAssistant:" \
-n 256 --temp 0.7
laabam-ai-3b-v1-Q4_K_M.gguffrom llama_cpp import Llama
llm = Llama(
model_path="laabam-ai-3b-v1-Q4_K_M.gguf",
n_ctx=1024,
n_threads=8,
)
output = llm.create_chat_completion(messages=[
{"role": "system", "content": "You are Agni, a helpful multilingual AI assistant."},
{"role": "user", "content": "भारत के बारे में बताओ।"}
])
print(output["choices"][0]["message"]["content"])
output = llm.create_chat_completion(messages=[
{"role": "system", "content": "நீங்கள் அக்னி AI. தமிழில் பதிலளிக்கவும்."},
{"role": "user", "content": "சிலப்பதிகாரம் பற்றி சொல்லுங்கள்."}
])
print(output["choices"][0]["message"]["content"])
| Detail | Value |
|---|---|
| Model Name | Agni Lite 3B v1 |
| Developer | Laabam One Business Solutions (OPC) Private Limited |
| Architecture | Qwen2.5 (3B parameters) |
| Training Method | QLoRA (r=16, alpha=32, 4-bit NF4) with Unsloth |
| Training Data | ~98,000 curated multilingual samples |
| Quantization Tool | llama.cpp (convert + quantize) |
| License | Agni Community License |
@misc{agni-lite-3b-v1-gguf,
title={Agni Lite 3B v1: India's Multilingual AI Assistant (GGUF)},
author={Laabam One Business Solutions (OPC) Private Limited},
year={2026},
url={https://huggingface.co/laabamone/laabam-ai-3b-v1-gguf}
}
Built with 🔥 in India by Laabam One Business Solutions (OPC) Private Limited
</div>