Downloads · 30 days
13
17% of all-time downloads
FlatOrcamaid-13b-v0.2-8bit-mlx
Kooten/FlatOrcamaid-13b-v0.2-8bit-mlx
FlatOrcamaid-13b-v0.2-8bit-mlx is a text generation model from Kooten. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
MLX quants of NeverSleep/FlatOrcamaid-13b-v0.2
All-time downloads
78
Public
Repo size
14 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors14 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- llama
- Access
- Public
- Created
- Jan 4, 2024
- Updated
- Jan 4, 2024
- SHA
- 97177e94
Try a prompt
Model card
From the Hugging Face model README
FlatOrcamaid-13b-v0.2 8bit MLX
MLX quants of NeverSleep/FlatOrcamaid-13b-v0.2
This is an MLX quant of of FlatOrcamaid, MLX is for use with Apple silicon. The 4bpw fits seems to work well on my 16gig M1 MBP, 8bpw needs more ram.
Other Quants:
-Exllama: 8bpw, 6bpw, 5bpw, 4bpw
Prompt template: Custom format, or Alpaca
Custom format:
SillyTavern config files: Context, Instruct.
Alpaca:
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
Contact
Kooten on discord.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-nc-4.0
- Created
- Jan 4, 2024
- Updated
- Jan 4, 2024