Jan-nano-gguf

Menlo/Jan-nano-gguf

Jan-nano-gguf is a text generation model from Menlo. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.

<subNote: Jan-Nano is a non-thinking model.</sub

Downloads · 30 days

3.9K

3% of all-time downloads

All-time downloads

141K

Public

Repo size

169 GB

Likes

142

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf37.5 GB · 100%

At a glance

Task: Text Generation
License: apache-2.0
Access: Public
Created: Jun 11, 2025
Updated: Jul 1, 2025
SHA: d6d76c0f

Try a prompt

Base models

Menlo/Jan-nano

Model card

From the Hugging Face model README

Jan Nano

<sub>Note: Jan-Nano is a non-thinking model.</sub>

Authors: Alan Dao, Bach Vu Dinh

image/png

Overview

Jan Nano is a fine-tuned language model built on top of the Qwen3 architecture. Developed as part of the Jan ecosystem, it balances compact size and extended context length, making it ideal for efficient, high-quality text generation in local or embedded environments.

Features

Tool Use: Excellent function calling and tool integration
Research: Enhanced research and information processing capabilities
Small Model: VRAM efficient for local deployment

Use it with Jan (UI)

Install Jan using Quickstart

Original weight: https://huggingface.co/Menlo/Jan-nano

Recommended Sampling Parameters

Temperature: 0.7
Top-p: 0.8
Top-k: 20
Min-p: 0

📄 Citation

@misc{dao2025jannanotechnicalreport,
      title={Jan-nano Technical Report}, 
      author={Alan Dao and Dinh Bach Vu},
      year={2025},
      eprint={2506.22760},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2506.22760}, 
}

Documentation

Setup, Usage & FAQ

Task: Text Generation
License: apache-2.0
Created: Jun 11, 2025
Updated: Jul 1, 2025