Downloads · 30 days
34
13% of all-time downloads
gemma-3-270m-it-web-agent-gguf
ArunKr/gemma-3-270m-it-web-agent-gguf
gemma-3-270m-it-web-agent-gguf is a text generation model from ArunKr. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This repository contains three variants of the model:
All-time downloads
260
Public
Repo size
583 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf292 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Sep 25, 2025
- Updated
- Sep 25, 2025
- SHA
- bd9d18c5
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
gemma-3-270m-it-web-agent - Fine-tuned
This repository contains three variants of the model:
- LoRA adapters → ArunKr/gemma-3-270m-it-web-agent-lora
- Merged FP16 weights → ArunKr/gemma-3-270m-it-web-agent-16bit
- GGUF quantizations → ArunKr/gemma-3-270m-it-web-agent-gguf
Training
- Base model:
unsloth/gemma-3-270m-it - Dataset:
ArunKr/gui_grounding_dataset-100 - Method: LoRA fine-tuning with Unsloth
Quantizations
We provide f16, bf16, f32, and q8_0 GGUF files for llama.cpp / Ollama.
Usage Example
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("ArunKr/gemma-3-270m-it-web-agent-16bit")
model = AutoModelForCausalLM.from_pretrained("ArunKr/gemma-3-270m-it-web-agent-16bit")
print(model.generate(**tok("Hello", return_tensors="pt")))
Ollama Example
ollama run ArunKr/SmolLM-135M-Instruct-manim-gguf:<file_name>.gguf
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- Sep 25, 2025
- Updated
- Sep 25, 2025