Downloads · 30 days
138
23% of all-time downloads
PraneetNS/EduMentor-Qwen3-4B-v2-GGUF
EduMentor-Qwen3-4B-v2-GGUF is a text generation model from PraneetNS. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as apache-2.0.
This repository contains GGUF quantized versions of EduMentor Qwen3 4B v2, an AI engineering mentor designed for university students, technical learning, coding assistance, project guidance, and placement preparation.
Downloads · 30 days
138
23% of all-time downloads
All-time downloads
600
Public
Repo size
18.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf18.1 GB · 100%
From the Hugging Face model README
This repository contains GGUF quantized versions of EduMentor Qwen3 4B v2, an AI engineering mentor designed for university students, technical learning, coding assistance, project guidance, and placement preparation.
These models are converted from the merged FP16 checkpoint and optimized for inference with llama.cpp, LM Studio, Ollama (GGUF import), Open WebUI, Jan, and other GGUF-compatible runtimes.
FP16 Repository
https://huggingface.co/PraneetNS/EduMentor-Qwen3-4B-v2-FP16
| File | Size | Recommended For |
|---|---|---|
| EduMentor-Qwen3-4B-v2-F16.gguf | ~7.5 GB | Maximum quality |
| EduMentor-Qwen3-4B-v2-Q8_0.gguf | ~4.0 GB | Near-FP16 quality |
| EduMentor-Qwen3-4B-v2-Q6_K.gguf | ~3.1 GB | Best balance of quality and speed |
| EduMentor-Qwen3-4B-v2-Q4_K_M.gguf | ~2.4 GB | Fast local inference |
EduMentor v2 is fine-tuned for engineering education and technical mentoring.
It supports:
EduMentor is optimized for multimodal tutoring systems.
Typical responses follow the structure:
{
"speech": "...",
"display": {
"type": "code | notes | roadmap | table | diagram",
"content": "..."
},
"follow_up": "..."
}
This enables voice assistants to speak only natural explanations while rendering code, diagrams, or notes separately.
Explain Binary Search.
{
"speech": "Binary Search repeatedly divides the search interval in half, making it much faster than linear search on sorted arrays.",
"display": {
"type": "code",
"language": "python",
"content": "def binary_search(...): ..."
},
"follow_up": "Would you like to understand its time complexity?"
}
./llama-cli \
-m EduMentor-Qwen3-4B-v2-Q4_K_M.gguf \
-c 4096 \
-p "Explain recursion simply."
| Hardware | Recommendation |
|---|---|
| 8 GB RAM | Q4_K_M |
| 16 GB RAM | Q6_K |
| 24 GB+ RAM | Q8_0 |
| GPU Servers | F16 |
EduMentor may occasionally:
The model should not replace professional engineering advice.
Base Architecture:
Fine-tuning:
Praneet N S
EduMentor is an ongoing effort to build an AI mentor capable of providing high-quality engineering education through natural conversations and voice-first tutoring systems.