Downloads · 30 days
453
4% of all-time downloads
lukasdrews/Gemma-4-E2B-IT-SFT-RLVR-Medical-GGUF
Gemma-4-E2B-IT-SFT-RLVR-Medical-GGUF is a text generation model from lukasdrews. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Gemma-4-E2B-it fine-tuned on PubMedQA using SFT and RLVR.<br Also check out the training code on GitHub.<br
Downloads · 30 days
453
4% of all-time downloads
All-time downloads
11.6K
Public
Repo size
57.5 GB
Likes
3
Public
Click a slice to open those files.
.gguf57.4 GB · 100%
From the Hugging Face model README
Gemma-4-E2B-it fine-tuned on PubMedQA using SFT and RLVR.<br> Also check out the training code on GitHub.<br>
# !pip install llama-cpp-python
from llama_cpp import Llama
llm = Llama.from_pretrained(
repo_id="lukasdrews/Gemma-4-E2B-IT-SFT-RLVR-Medical-GGUF",
filename="gemma-4-E2B-it-sft-rlvr-medical-Q4_K_M.gguf",
verbose=False,
)
messages = [
{
"role": "user",
"content": [
{"type": "text", "text": "Do GEC produce and bear factor H under complement attack?"}
]
},
]
outputs = llm.create_chat_completion(messages, max_tokens=1024)
print(outputs["choices"][0]["message"]["content"])
| Model | Quantization | PubMedQA<br>(In-Domain) | MedQA-USMLE<br>(Zero-Shot Transfer) |
|---|---|---|---|
| Gemma-4-E2B-it (base model) | - | 58.10 % | 29.54 % |
| Gemma-4-E2B-it + SFT + RLVR | - | 73.10 % | 43.05 % |
| Gemma-4-E2B-it + SFT + RLVR | Q8_0 | 72.40 % | 43.00 % |
| Gemma-4-E2B-it + SFT + RLVR | Q6_K | 72.10 % | 42.18 % |
| Gemma-4-E2B-it + SFT + RLVR | Q5_K_M | 72.00 % | 38.88 % |
| Gemma-4-E2B-it + SFT + RLVR | Q4_K_M | 71.80 % | 38.88 % |