Downloads · 30 days
9
3% of all-time downloads
dungnvt/Qwen3-4B-Thinking-2507-LUT444-ctx4096_0.3.4-anemll
Qwen3-4B-Thinking-2507-LUT444-ctx4096_0.3.4-anemll is a text generation model from dungnvt. Use it when you need the model to write or continue text. The card lists the license as mit.
This is a CoreML model converted using ANEMLL for Apple Neural Engine inference.
Downloads · 30 days
9
3% of all-time downloads
All-time downloads
286
Public
Repo size
2.2 GB
Likes
0
Public
Click a slice to open those files.
.bin2.2 GB · 99%
From the Hugging Face model README
This is a CoreML model converted using ANEMLL for Apple Neural Engine inference.
Thanks for ANEMLL
chat.py provides a sample inference script.
chat_full.py provides a sample inference script with history and conversation management.
Installation
# Install required tools
pip install huggingface_hub
# Install Git LFS (Large File Support)
# macOS with Homebrew:
brew install git-lfs
# Initialize Git LFS
git lfs install
# Clone the repository with model files
git clone https://huggingface.co/dungnvt/Qwen3-4B-Thinking-2507-LUT444-ctx4096_0.3.4-anemll
# Navigate to cloned directory
cd Qwen3-4B-Thinking-2507-LUT444-ctx4096_0.3.4-anemll
# Pull LFS files (model weights)
git lfs pull
# Extract CoreML model files
find . -type f -name "*.zip" -exec unzip {} \;
pip install coremltools transformers
Coremltools:
See coremltools installation guide at https://coremltools.readme.io/v4.0/docs/installation
How to Run
python chat.py --meta ./meta.yaml
python chat_full.py --meta ./meta.yaml
Note: The first time the model loads, macOS will take some time to place it on the device. Subsequent loads will be instantaneous. Use Ctrl-D to exit, Ctrl-C to interrupt inference.
Try our sample Chat-Bot app on TestFlight:
[!Note]
- The TestFlight app works on both iOS and macOS
- Demonstrates proper model integration and provides a reference implementation
- iOS requires unzipped MLMODELC files and config.json for offline tokenizer
- macOS supports both zipped and unzipped model formats