Downloads · 30 days
9
5% of all-time downloads
FlatOrcamaid-13b-v0.2-4bit-mlx
Kooten/FlatOrcamaid-13b-v0.2-4bit-mlx
FlatOrcamaid-13b-v0.2-4bit-mlx is a text generation model from Kooten. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
MLX quants of NeverSleep/FlatOrcamaid-13b-v0.2
All-time downloads
187
Public
Repo size
7.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- llama
- Access
- Public
- Created
- Jan 4, 2024
- Updated
- Jan 4, 2024
- SHA
- 47eafedf
Try a prompt
Model card
From the Hugging Face model README
FlatOrcamaid-13b-v0.2 4bit MLX
MLX quants of NeverSleep/FlatOrcamaid-13b-v0.2
This is an MLX quant of of FlatOrcamaid, MLX is for use with Apple silicon. The 4bpw fits seems to work well on my 16gig M1 MBP, 8bpw needs more ram.
Other Quants:
-Exllama: 8bpw, 6bpw, 5bpw, 4bpw
Prompt template: Custom format, or Alpaca
Custom format:
SillyTavern config files: Context, Instruct.
Alpaca:
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
Contact
Kooten on discord.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-nc-4.0
- Created
- Jan 4, 2024
- Updated
- Jan 4, 2024