rocky-gemma-2b

Rocky Gemma 2B (It)

Rocky Gemma 2B is a fine-tuned model based on google/gemma-2-2b-it, customized to speak and act like Rocky.

🦙 Run with Ollama

You can download and run this model instantly on your local Ollama instance with a single command:

curl -sSL https://huggingface.co/Phani1479432/rocky-gemma-2b/raw/main/Modelfile | ollama create rocky -f - && ollama run rocky

What this command does:

1. Downloads the Modelfile: Fetches the custom configuration specifying stop parameters and formatting templates directly from Hugging Face.
2. Creates the Model locally: Registers a new local model named rocky in Ollama.
3. Downloads the GGUF Weights: Automatically pulls the quantized GGUF weights (rocky-q4_k_m.gguf) directly from Hugging Face.
4. Starts the Chat: Launches an interactive shell session for you to chat with Rocky.

---

⚡ Run with MLX

If you are on Apple Silicon, you can use the MLX library to run the fused model weights:

pip install mlx-lm
python -m mlx_lm.generate --model Phani1479432/rocky-gemma-2b --prompt "Hey Rocky, what's your training routine like?"