Downloads · 30 days
42
5% of all-time downloads
dawncr0w/Hy-MT2-30B-A3B-oQ4-MLX
Hy-MT2-30B-A3B-oQ4-MLX is a translation model from dawncr0w. Use it when you need text moved from one language to another. It is set up for mlx. The card lists the license as other.
This is an oQ4 MLX quantized derivative of tencent/Hy-MT2-30B-A3B.
Downloads · 30 days
42
5% of all-time downloads
All-time downloads
824
Public
Parameters
30.1B
17.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors17.4 GB · 100%
How the weights are stored.
U3230.1B · 100%
From the Hugging Face model README
This is an oQ4 MLX quantized derivative of tencent/Hy-MT2-30B-A3B.
The model was quantized locally with oMLX oQ4. The resulting config targets approximately 4.62 bpw and includes a packaged hy_v3.py model file so MLX-LM can load the HYV3 architecture from the model directory.
Local validation completed with the oMLX app bundle on macOS:
mlx_lm load: passed
generation smoke test: passed
prompt: Hello
max tokens: 4
peak memory: 17.435 GB
Use an MLX-LM build that supports the APIs used by the packaged hy_v3.py file.
python -m mlx_lm generate \
--model /path/to/Hy-MT2-30B-A3B-oQ4-MLX \
--ignore-chat-template \
--prompt "Hello" \
--max-tokens 32 \
--temp 0
The base model is distributed under the Tencent HY Community License Agreement. This distribution includes LICENSE.txt and NOTICE from/for the Tencent HY license requirements.
This repository is not affiliated with, sponsored by, or endorsed by Tencent.