Downloads · 30 days
11
2% of all-time downloads
darthcrawl/artifex-rp-orpheus-llama-3.1-8b-mlx-8bit
artifex-rp-orpheus-llama-3.1-8b-mlx-8bit is a text generation model from darthcrawl. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as llama3.1.
Downloads · 30 days
11
2% of all-time downloads
All-time downloads
553
Public
Parameters
8B
9.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors9 GB · 100%
How the weights are stored.
U328B · 100%
From the Hugging Face model README
Part of the Artifex RP series.
MLX 8-bit (group-size 32) quantization of artifex-rp-orpheus-llama-3.1-8b for Apple Silicon.
For full model details, sample outputs, and training notes → see the main model card.
pip install mlx-lm
mlx_lm.generate --model darthcrawl/artifex-rp-orpheus-llama-3.1-8b-mlx-8bit \
--system-prompt "Write in vivid, restrained, intelligent prose. Concrete sensory detail. Never pretentious. Tension carries more weight than description. Match the user's energy and length." \
--prompt "She hadn't seen him in three years." \
--temp 0.85 --top-p 0.95 --max-tokens 400
| Parameter | Value |
|---|---|
| Bits | 8 |
| Group size | 32 |
| Effective bits/weight | 9.0 |
| Size | 8.4GB |
| Repo | Size | Fits on |
|---|---|---|
| artifex-rp-orpheus-llama-3.1-8b | ~16GB | 24GB+ Mac (BF16) |
| artifex-rp-orpheus-llama-3.1-8b-mlx-8bit | 8.4GB | 16GB Mac |
| artifex-rp-orpheus-llama-3.1-8b-mlx-6bit | 6.6GB | 16GB Mac |
| artifex-rp-orpheus-llama-3.1-8b-mlx-4bit-dwq | 4.7GB | 8GB Mac |
Weights inherit the base model license. See artifex-rp-orpheus-llama-3.1-8b.