Downloads · 30 days
139
13% of all-time downloads
Jan-nano-F32-GGUF
prithivMLmods/Jan-nano-F32-GGUF
Jan-nano-F32-GGUF is a text generation model from prithivMLmods. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Jan-Nano is a compact 4-billion parameter language model specifically designed and trained for deep research tasks. This model has been optimized to work seamlessly with Model Context Protocol (MCP) servers, enabling…
All-time downloads
1.1K
Public
Repo size
32.2 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf32.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Jun 16, 2025
- Updated
- Jun 16, 2025
- SHA
- 8d70ad72
Try a prompt
Base models
Model card
From the Hugging Face model README
Jan-nano-GGUF
Jan-Nano is a compact 4-billion parameter language model specifically designed and trained for deep research tasks. This model has been optimized to work seamlessly with Model Context Protocol (MCP) servers, enabling efficient integration with various research tools and data sources.
Model Files
| File Name | Size | Format | Description |
|---|---|---|---|
| Jan-nano.F32.gguf | 16.1 GB | F32 | Full precision 32-bit floating point |
| Jan-nano.F16.gguf | 8.05 GB | F16 | Half precision 16-bit floating point |
| Jan-nano.BF16.gguf | 8.05 GB | BF16 | Brain floating point 16-bit |
Usage
These GGUF format files are optimized for use with llama.cpp and compatible inference engines. Choose the appropriate precision level based on your hardware capabilities and quality requirements:
- F32: Highest quality, requires most memory
- F16/BF16: Good balance of quality and memory efficiency
Configuration
The model configuration is available in config.json.
Quants Usage
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3
- License
- apache-2.0
- Languages
- en
- Created
- Jun 16, 2025
- Updated
- Jun 16, 2025