Downloads · 30 days
19
4% of all-time downloads
qwen_v3_gguf
nikhil-singh-iphtech/qwen_v3_gguf
qwen_v3_gguf is a machine learning model from nikhil-singh-iphtech. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Fine-tuned version of Qwen/Qwen3-0.6B on the mEinstein personal AI assistant dataset.
All-time downloads
476
Public
Repo size
2.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf2.2 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jun 18, 2026
- Updated
- Jun 18, 2026
- SHA
- 5fcff0d8
Base models
Model card
From the Hugging Face model README
Qwen3-0.6B mEinstein GGUF
Fine-tuned version of Qwen/Qwen3-0.6B on the mEinstein personal AI assistant dataset.
Available Quantizations
| File | Format | Size | Use case |
|---|---|---|---|
Qwen_mEinstein_F16.gguf | F16 | ~1.2 GB | Highest quality |
Qwen_mEinstein_Q8_0.gguf | Q8_0 | ~0.6 GB | Balanced |
Qwen_mEinstein_Q4_K_M.gguf | Q4_K_M | ~0.4 GB | Fastest / lightest |
How to Run
./llama-cli -m Qwen_mEinstein_Q4_K_M.gguf -p "Who am I?" -n 256
Training Details
- Base model: Qwen/Qwen3-0.6B
- Method: QLoRA (4-bit) + SFT
- LoRA target modules: q_proj, k_proj, v_proj, o_proj
- Dataset: mEinstein personal assistant dataset
- License
- apache-2.0
- Languages
- en
- Created
- Jun 18, 2026
- Updated
- Jun 18, 2026