Downloads · 30 days
80
10% of all-time downloads
Auguments/LiquidAI-LFM2.5-Audio-1.5B-GGUF-BF16
LiquidAI-LFM2.5-Audio-1.5B-GGUF-BF16 is a machine learning model from Auguments. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for gguf.
Highest quality quant - original LiquidAI's GGUFs are FP16, which may degrade quality by clipping values. (Or maybe not, but why risk it?)
Downloads · 30 days
80
10% of all-time downloads
All-time downloads
788
Public
Repo size
5.1 GB
Likes
1
Public
Click a slice to open those files.
.gguf5.1 GB · 100%
From the Hugging Face model README
Highest quality quant - original LiquidAI's GGUFs are FP16, which may degrade quality by clipping values. (Or maybe not, but why risk it?)
In this repo:
Base model in BF16, and Q6_K converted from BF16
Mmproj in BF16
Vocoder in BF16
TTS tokenizer in BF16 and F32 (original tensors are F32)
Combined vocoder+tokenizer in BF16
Base and mmproj converted using base llama.cpp, tokenizer and vocoder converted using the script from https://github.com/ggml-org/llama.cpp/pull/18641
Text and ASR inference works in baseline llama.cpp. For TTS, use their fork.