Skip to content

heni86

magnum-v2.5-12b-kto_mlx-8bpw

heni86/magnum-v2.5-12b-kto_mlx-8bpw

magnum-v2.5-12b-kto_mlx-8bpw is a text generation model from heni86. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.

Quantized to 8bpw and tested using the mlxlm utility on a 64GiB URAM M1 Max.

Downloads · 30 days

17

20% of all-time downloads

All-time downloads

86

Public

Parameters

3.4B

13 GB on disk

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors13 GB · 100%

Parameter types

How the weights are stored.

U323.1B · 89%

Try a prompt

Base models

Task
Text Generation
Type
mistral
License
apache-2.0
Languages
en, fr, de, es, it, pt
Created
Oct 18, 2024
Updated
Oct 18, 2024