Downloads · 30 days
0
mlc-chat-una-cybertron-7b-v2-bf16-q3f16_1
jmfirth/mlc-chat-una-cybertron-7b-v2-bf16-q3f16_1
mlc-chat-una-cybertron-7b-v2-bf16-q3f16_1 is a machine learning model from jmfirth. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
An MLC-compiled version of Una Cybertron 7B BF16 quantized to q3f16 for running locally on mobile devices.
Access
Public
Updated Dec 13, 2023
Repo size
3.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin3.3 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Dec 9, 2023
- Updated
- Dec 13, 2023
- SHA
- 7caaeafa
Model card
From the Hugging Face model README
mlc-chat-una-cybertron-7b-v2-bf16-q3f16_1
An MLC-compiled version of Una Cybertron 7B BF16 quantized to q3f16 for running locally on mobile devices.
Requires a build of MLC Chat for iOS that supports Mistral. As of 12/12/23, that means you will need to build MLC Chat for iOS from source at mlc-llm @ MLC.ai on Github.
Its currently configured to support the ChatML conversation template, but really it is supposed to be ChatML + a custom system message.
- License
- apache-2.0
- Created
- Dec 9, 2023
- Updated
- Dec 13, 2023