grpo-acr-adapters

🧠 GRPO Adapter Models for Medical Reasoning (LLaMA 3.1 8B)

This repository hosts four adapter models trained with Group Relative Policy Optimization (GRPO) on top of LLaMA 3.1 8B, targeting the task of medical imaging appropriateness classification. These models were trained to replicate and align with expert clinical reasoning provided by the American College of Radiology (ACR).

---

🔬 Model Variants and Reward Designs

---

📁 Files

• baseline\adapter_model.safetensors
• citations\adapter_model.safetensors
• llm-eval\adapter_model.safetensors
• custom_embedding\adapter_model.safetensors

Each file contains an adapter for the LLaMA 3.1 8B model, trained on ~1800 variant/procedure pairs across ~30 medical conditions, using custom RL rewards.

---

🩺 About the Task

The task is to recommend whether a specific imaging procedure is:

• Usually Appropriate
• May Be Appropriate
• Usually Not Appropriate

The agent is trained to not only predict the correct label but justify it step-by-step, mimicking the ACR’s clinical reasoning process and referencing relevant medical studies.

---

📬 Collaboration & Citation

Interested in medical AI, reinforcement learning, or clinical reasoning? Let's connect!
This work is part of a larger research effort on interpretable LLM agents in healthcare. Please cite or reach out if using these adapters in your work. 🙌