Downloads · 30 days
15
1% of all-time downloads
Krishkanth/krish-mind-gguf-Q4
krish-mind-gguf-Q4 is a text generation model from Krishkanth. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Downloads · 30 days
15
1% of all-time downloads
All-time downloads
1.3K
Public
Repo size
21 GB
Likes
0
Public
Click a slice to open those files.
.gguf4.9 GB · 100%
From the Hugging Face model README
✨ Krish Mind is an elite independent AI assistant developed by Krish CS. ✨ 🧠 Designed to be intelligent, helpful, and powerful on standard computers!
</div>Krish Mind is a state-of-the-art independent AI assistant developed by Krish CS. It has its own unique identity, personality, and knowledge base, and is designed to be genuinely helpful and conversational.
Krish Mind Q4 is the balanced edition, quantized using the Q4_K_M algorithm. It is designed for standard laptops and desktop computers with 8-16 GB of RAM. It delivers excellent intelligence and response quality in a manageable ~5 GB file size.
⚠️ Note on Mobile: This Q4 version at ~5 GB is too large to run on smartphones. If you want to use Krish Mind on your phone, please use the Mobile version instead: 📱 Krish Mind Mobile (~2 GB)
| 🏷️ Version | 📦 Size | 💾 RAM | 📱 Mobile | 💻 Desktop | ⬇️ Action |
|---|---|---|---|---|---|
| 📱 Mobile | ~2 GB | 3-4 GB | ✅ Yes | ✅ Yes | 🔗 Visit Repository |
| ⚡ Q4 Balanced (This Repo) | ~5 GB | 8-16 GB | ❌ No | ✅ Yes | 📥 Download Now |
| 🚀 Full Quality | ~16 GB | 32+ GB | ❌ No | ✅ Yes | 🔗 Visit Repository |
| krish-mind-standalone-Q4.gguf | ~5 GB | 📥 Download Now |
You can test Krish Mind Q4 instantly without downloading anything! We have deployed a live version to Hugging Face Spaces:
🔗 Chat with Krish Mind Q4 (Live)
Ollama is a free, open-source tool that runs AI models locally with simple commands. Works on Windows, Mac, and Linux with no complicated setup.
Step 1: Install Ollama
.exe file and follow the installer stepsStep 2: Download the Model File
krish-mind-standalone-Q4.gguf from the download link at the top of this pageC:\Users\YourName\krish-mind\Step 3: Create a Modelfile
New Text Document.txt to exactly Modelfile (delete the .txt extension)FROM ./krish-mind-standalone-Q4.gguf
Step 4: Import into Ollama
Windows + R, type cmd, and press Enter to open Command Promptcd C:\Users\YourName\krish-mind
ollama create krish-mind -f Modelfile
Step 5: Start Chatting!
ollama run krish-mind
Type your message and press Enter. To exit, type /bye.
Step 1: Install Ollama
.zip file and drag Ollama to your Applications folderStep 2: Download the Model File
krish-mind-standalone-Q4.gguf from the link at the top of this page~/Downloads/krish-mind/Step 3: Create a Modelfile
Cmd + Space, type Terminal, press Enter)mkdir -p ~/Downloads/krish-mind
cd ~/Downloads/krish-mind
echo 'FROM ./krish-mind-standalone-Q4.gguf' > Modelfile
(Make sure your GGUF file is in this same folder)
Step 4: Import into Ollama
ollama create krish-mind -f Modelfile
Step 5: Start Chatting!
ollama run krish-mind
Step 1: Install Ollama
curl -fsSL https://ollama.ai/install.sh | sh
Step 2: Download the Model File
mkdir -p ~/krish-mind && cd ~/krish-mind
wget "https://huggingface.co/Krishkanth/krish-mind-gguf-Q4/resolve/main/krish-mind-standalone-Q4.gguf"
Step 3: Create the Modelfile
echo 'FROM ./krish-mind-standalone-Q4.gguf' > Modelfile
Step 4: Import and Run
ollama create krish-mind -f Modelfile
ollama run krish-mind
LM Studio gives you a beautiful ChatGPT-style interface running entirely on your own computer.
Step 1: Download LM Studio from https://lmstudio.ai
Step 2: Download krish-mind-standalone-Q4.gguf to your computer from the link above
Step 3: Open LM Studio and click the folder icon on the left sidebar (My Models section)
Step 4: Click Add Model and either:
Step 5: Click the AI Chat icon on the left sidebar (speech bubble icon)
Step 6: At the very top of the chat window, click the model selector dropdown and choose krish-mind-standalone-Q4
Step 7: Start typing in the chat box and press Enter — Krish Mind will respond!
Install the library:
pip install llama-cpp-python
Run Krish Mind in your code:
from llama_cpp import Llama
llm = Llama(
model_path="./krish-mind-standalone-Q4.gguf",
n_ctx=4096,
n_threads=8,
)
response = llm.create_chat_completion(
messages=[{"role": "user", "content": "Hello! Who are you?"}]
)
print(response["choices"][0]["message"]["content"])
| 💻 Platform | 🥉 Minimum | 🥇 Recommended |
|---|---|---|
| Windows | 8 GB RAM, Intel i5 / AMD Ryzen 5 | 16 GB RAM, Intel i7 / AMD Ryzen 7 |
| Mac | 8 GB RAM, Apple M1 | 16 GB RAM, Apple M2 or newer |
| Linux | 8 GB RAM, Any x86_64 CPU | 16 GB RAM |
Storage Space Required: 6 GB free space
📱 Want to use Krish Mind on your phone? The Q4 version is too large for most smartphones. Download the Mobile Version (~2 GB) instead!
Q: My laptop has 8 GB RAM. Will this run? A: Yes! The Q4 version is designed exactly for 8 GB RAM laptops. Ollama and LM Studio will manage memory automatically.
Q: Can I run this without any GPU? A: Yes. Krish Mind Q4 runs entirely on your CPU. No graphics card needed.
Q: Does it work offline? A: Yes. After the first download, everything runs 100% offline. No internet required.
Q: Is this free? A: Yes. Released under Apache 2.0 — free for personal and commercial use.
✨ Happy Chatting with Krish Mind Q4! ✨ Made with ❤️ by Krish CS
</div>