Downloads · 30 days
11
7% of all-time downloads
typealias/llm-compiler-13b-ftd-mlx
llm-compiler-13b-ftd-mlx is a machine learning model from typealias. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as other.
The Model typealias/llm-compiler-13b-ftd-mlx was converted to MLX format from typealias/llm-compiler-13b-ftd using mlx-lm version 0.15.0.
Downloads · 30 days
11
7% of all-time downloads
All-time downloads
164
Public
Parameters
13B
26 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors26 GB · 100%
From the Hugging Face model README
The Model typealias/llm-compiler-13b-ftd-mlx was converted to MLX format from typealias/llm-compiler-13b-ftd using mlx-lm version 0.15.0.
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("typealias/llm-compiler-13b-ftd-mlx")
response = generate(model, tokenizer, prompt="hello", verbose=True)