Downloads · 30 days
37
9% of all-time downloads
TeamDelta/LFM-2.5-1.2B-Novel-JP-GGUF
LFM-2.5-1.2B-Novel-JP-GGUF is a text generation model from TeamDelta. Use it when you need the model to write or continue text. The card lists the license as other.
GGUF quantized versions of a fine-tuned LiquidAI LFM2.5-1.2B (Japanese) model, converted with llama.cpp for local inference.
Downloads · 30 days
37
9% of all-time downloads
All-time downloads
426
Public
Repo size
5.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf5.2 GB · 100%
From the Hugging Face model README
GGUF quantized versions of a fine-tuned LiquidAI LFM2.5-1.2B (Japanese) model, converted with llama.cpp for local inference.
LiquidAI/LFM2.5-1.2B-JP-202606Lfm2ForCausalLM)| File | Quant | Size | Notes |
|---|---|---|---|
LFM-2.5-1.2B-Novel-JP-F16.gguf | F16 | ~2.3 GB | Full precision, highest quality |
LFM-2.5-1.2B-Novel-JP-Q8_0.gguf | Q8_0 | ~1.2 GB | Near-lossless |
LFM-2.5-1.2B-Novel-JP-Q5_K_M.gguf | Q5_K_M | ~843 MB | Balanced quality/size |
LFM-2.5-1.2B-Novel-JP-Q4_K_M.gguf | Q4_K_M | ~731 MB | Smallest, recommended for most uses |
huggingface-cli download TeamDelta/LFM-2.5-1.2B-Novel-JP-GGUF \
LFM-2.5-1.2B-Novel-JP-Q4_K_M.gguf --local-dir .
llama-cli -m LFM-2.5-1.2B-Novel-JP-Q4_K_M.gguf -p "こんにちは" -cnv
ollama run hf.co/TeamDelta/LFM-2.5-1.2B-Novel-JP-GGUF:Q4_K_M
Converted and uploaded with llama.cpp inside the Unsloth Docker image.