Downloads · 30 days
107
17% of all-time downloads
IntelligentEstate/HammerHead-7b-Q4_k_m.gguf
HammerHead-7b-Q4_k_m.gguf is a machine learning model from IntelligentEstate. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
4Bit Quants, 1 using a business and normalized importance matrix and another just normal km Quant for side by side testing. both mimic the multi-in-turn-function-calling now popularized by many large scale services.
Downloads · 30 days
107
17% of all-time downloads
All-time downloads
632
Public
Repo size
9.4 GB
Likes
1
Public
Click a slice to open those files.
.gguf9.4 GB · 100%
From the Hugging Face model README
4Bit Quants, 1 using a business and normalized importance matrix and another just normal k_m Quant for side by side testing. both mimic the multi-in-turn-function-calling now popularized by many large scale services.

This model was converted to GGUF format from MadeAgents/Hammer2.1-7b using llama.cpp
Install llama.cpp through brew (works on Mac and Linux)
brew install llama.cpp
Invoke the llama.cpp server or the CLI.