ollama-q4_k_m-Qwen2.5-0.5B

---

    license: apache-2.0
    base_model: Qwen/Qwen2.5-0.5B
    tags:
    - gguf
    - ollama
    - quantized
    - q4_k_m
    ---

    # Qwen2.5-0.5B - Quantized GGUF Model

    This is a quantized GGUF model (Q4_K_M) compatible with Ollama.

    ## Model Details
    - **Base Model**: Qwen/Qwen2.5-0.5B
    - **Quantization**: Q4_K_M
    - **Framework**: Ollama

    ## Usage with Ollama

    You can pull and run this model directly with Ollama:

    ```bash
    ollama pull hf.co/BondingAI/ollama-q4_k_m-Qwen2.5-0.5B:Q4_K_M
    ```

    Then run it:

    ```bash
    ollama run hf.co/BondingAI/ollama-q4_k_m-Qwen2.5-0.5B:Q4_K_M "Write your prompt here"
    ```

    ## Features
    - Efficient quantization (Q4_K_M) for faster inference
    - Compatible with Ollama's inference engine

    ## License
    Please refer to the original model card for licensing information.