Downloads · 30 days
400
42% of all-time downloads
Flexan/FoxyzGPT-1.1-7B-GGUF
FoxyzGPT-1.1-7B-GGUF is a text generation model from Flexan. Use it when you need the model to write or continue text.
These are the GGUF files for Flexan/FoxyzGPT-1.1-7B.
Downloads · 30 days
400
42% of all-time downloads
All-time downloads
951
Public
Repo size
73.5 GB
Likes
1
Public
Click a slice to open those files.
.gguf73.5 GB · 100%
From the Hugging Face model README
These are the GGUF files for Flexan/FoxyzGPT-1.1-7B.
| GGUF Link | Quantization | Description |
|---|---|---|
| Download | Q2_K | Lowest quality |
| Download | IQ3_XS | Integer quant |
| Download | Q3_K_S | |
| Download | IQ3_S | Integer quant, preferable over Q3_K_S |
| Download | IQ3_M | Integer quant |
| Download | Q3_K_M | |
| Download | Q3_K_L | |
| Download | IQ4_XS | Integer quant |
| Download | Q4_K_S | Fast with good performance |
| Download | Q4_K_M | Recommended: Perfect mix of speed and performance |
| Download | Q5_K_S | |
| Download | Q5_K_M | |
| Download | Q6_K | Very good quality |
| Download | Q8_0 | Best quality |
| Download | f16 | Full precision, don't bother; use a quant |
FoxyzGPT 1.1 7B is a 7B large language model used for text generation.
FoxyzGPT 1.1 7B is a 7B parameter instruct LLM by Foxyz. The model was LoRA fine-tuned with unsloth/mistral-7b-instruct-v0.3-bnb-4bit as base model using Unsloth.
FoxyzGPT 1.1 7B uses the ChatML format, e.g.:
<|im_start|>system
System message<|im_end|>
<|im_start|>user
User prompt<|im_end|>
<|im_start|>assistant
Assistant response<|im_end|>