Downloads · 30 days
555
1% of all-time downloads
Lewdiculous/Fimbulvetr-11B-v2-GGUF-IQ-Imatrix
Fimbulvetr-11B-v2-GGUF-IQ-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
Model imatrix quants as requested at 36 for Sao10K/Fimbulvetr-11B-v2. <br Prompt Format: Alpaca or Vicuna.
Downloads · 30 days
555
1% of all-time downloads
All-time downloads
48.9K
Public
Repo size
67.3 GB
Likes
26
Public
Click a slice to open those files.
.gguf67.3 GB · 100%
From the Hugging Face model README
Model imatrix quants as requested at #36 for Sao10K/Fimbulvetr-11B-v2. <br> Prompt Format: Alpaca or Vicuna.
An absolute classic and highly popular roleplay model, now with newer quants as requested directly.
Imatrix data was generated from the FP16-GGUF and conversions as well since the original model weights are already FP16. <br> Using the latest version of llama.cpp at the time - b2774.
