Downloads · 30 days
36
4% of all-time downloads
AmeerHamza547/political-speech-classification-clf-llama-3.2-3b-GGUF
political-speech-classification-clf-llama-3.2-3b-GGUF is a text classification model from AmeerHamza547. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as llama3.2.
This repository contains the GGUF quantized version of a fine-tuned Llama 3.2 3B model specifically optimized for political speech transcript analysis. The model was fine-tuned using QLoRA via Unsloth and quantized in…
Downloads · 30 days
36
4% of all-time downloads
All-time downloads
857
Public
Repo size
2 GB
Likes
0
Public
Click a slice to open those files.
.gguf2 GB · 100%
From the Hugging Face model README
This repository contains the GGUF quantized version of a fine-tuned Llama 3.2 3B model specifically optimized for political speech transcript analysis. The model was fine-tuned using QLoRA via Unsloth and quantized into the highly efficient Q4_K_M format, making it perfect for fast, local inference on low-specification hardware (CPUs or low-VRAM laptops).
The model is optimized to perform two core downstream classification tasks using structured system prompts:
positive, negative, or neutral.economy, healthcare, education, social_welfare, security, and infrastructure..gguf)Q4_K_M (4-bit medium quantization using mixed precision)To run this model locally with Ollama, follow these quick steps:
.gguf file from the Files tab.Modelfile in the same directory and add the following content:FROM ./political-speech-classification-clf-llama-3.2-3b-Q4_K_M.gguf
# Set parameters
PARAMETER temperature 0.0
PARAMETER top_p 0.9
# You can adjust the system prompt depending on your task
SYSTEM "You are a political speech sentiment classifier. Analyze the speech and respond with ONLY one word: positive, negative, or neutral."