Downloads · 30 days
0
Araki/airoboros-33b-gpt4-1.4.1-PI-8192-GGML
airoboros-33b-gpt4-1.4.1-PI-8192-GGML is a text generation model from Araki. Use it when you need the model to write or continue text.
Quantization from: bhenrym14/airoboros-33b-gpt4-1.4.1-PI-8192-fp16
Downloads · 30 days
0
Access
Public
Updated Jul 16, 2023
Repo size
291 GB
Likes
2
Public
Click a slice to open those files.
.bin291 GB · 100%
From the Hugging Face model README
Quantization from: bhenrym14/airoboros-33b-gpt4-1.4.1-PI-8192-fp16
Converted to the GGML format with: llama.cpp master-6e7cca4 (JUL 15, 2023)
Tested with: koboldcpp 1.35
Example usage:
koboldcpp.exe airoboros-33b-gpt4-1.4.1-PI-8192-ggmlv3.Q2_K.bin --threads 6 --linearrope --contextsize 8192 --stream --smartcontext --unbantokens --noblas