Downloads · 30 days
113
16% of all-time downloads
Jan-v1-2509-GGUF
rodrigomt/Jan-v1-2509-GGUF
Jan-v1-2509-GGUF is a text generation model from rodrigomt. Use it when you need the model to write or continue text.
All-time downloads
705
Public
Repo size
15.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf15.7 GB · 100%
At a glance
- Task
- Text Generation
- Access
- Public
- Created
- Oct 3, 2025
- Updated
- Oct 6, 2025
- SHA
- 84b4bb29
Try a prompt
Base models
Model card
From the Hugging Face model README
🧠 Jan-v1-2509 GGUFs
Quantized version of: janhq/Jan-v1-2509
📦 Available GGUFs
| Format | Description |
|---|---|
| F16 | Full precision (16-bit), better quality, larger size ⚖️ |
| Q8_K_XL | Quantized (8-bit XL variant, based on the quantization table of the unsloth model Qwen3-4B-Thinking-2507), medium size, faster inference ⚡ |
| Q4_K_XL | Quantized (4-bit XL variant, based on the quantization table of the unsloth model Qwen3-4B-Thinking-2507), smaller size, faster inference ⚡ |
🚀 Usage
Example with llama.cpp:
./main -m ./gguf-file-name.gguf -p "Hello world!"
- Task
- Text Generation
- Created
- Oct 3, 2025
- Updated
- Oct 6, 2025