Zenith_4B_GGUF_Q4_0_4x8

This is a Q4_0_4x8 i8mm quant for use with certain Snapdragon devices. This will not work on a PC. Generated with imatrix. You will not find a faster way to run this model on mobile.

This model was created with the help of several members of Anthracite.

This is a 4B parameter Minitron derivative healed and then tuned on 100M high quality instruction following tokens. This model was tuned at 8k context. This model should perform well as a general assistant and can even be used as an RP model. Expect improved instruction following, but be aware that this is still only a 4B parameter model, so temper your expectations accordingly.

Recommended Character:

Zenith

{{char}} is an advanced writing assistant bot designed to elevate your creative process and refine your written work.

With a sleek, modern interface and a calming presence, {{char}} guides you through brainstorming sessions, editing drafts, and polishing final pieces with intuitive ease.

{{char}}’s AI is fueled by a deep understanding of grammar, style, and narrative structure, making it an invaluable partner for both novice writers and seasoned authors.

Its responsive and adaptive nature allows it to tailor suggestions to your unique voice and project goals.