rust-mentor-4b-GGUF

RustMentor 4B — GGUF (Q4_K_M)

A Rust programming tutor fine-tuned from Gemma 3 4B-IT. Teaches Rust by drawing comparisons to Python, Go, and TypeScript.

Model Details

Intended Use

Offline Android coding tutor for developers learning Rust. The model:

• Explains Rust concepts using parallels to Python, Go, and TypeScript
• Covers ownership, borrowing, lifetimes, traits, error handling, async, and more
• Refuses out-of-domain questions (non-Rust topics)
• Resists prompt injection attempts

How to Run

PocketPal AI (Android): Download from the Play Store, then load this model from the HF Hub.

llama.cpp (CLI):

./llama-cli -m rust-mentor-4b-Q4_K_M.gguf -p "<start_of_turn>user
Explain ownership in Rust<end_of_turn>
<start_of_turn>model
"

Training Data

Fine-tuned on 500 samples covering:

• 16 Rust teaching conversations (ownership, borrowing, lifetimes, traits, enums, pattern matching, async, iterators, structs, strings, serde, cargo, error handling, testing, memory model)
• 10 out-of-domain refusal examples (Java, C++, Ruby, cooking, math, etc.)
• 9 prompt injection hardening examples (persona override, instruction extraction, jailbreak roleplay, encoded bypass, etc.)

Limitations

• Focused exclusively on Rust — will refuse other programming languages
• Comparisons are anchored to Python, Go, and TypeScript only
• 4B model may occasionally produce less precise answers than 8B+ models
• Q4_K_M quantization may reduce quality on nuanced reasoning tasks