Downloads · 30 days
69
6% of all-time downloads
TinyLlama-1.1B-Chat-v0.6
mlx-community/TinyLlama-1.1B-Chat-v0.6
TinyLlama-1.1B-Chat-v0.6 is a machine learning model from mlx-community. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
All-time downloads
1.1K
Public
Repo size
2.2 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.npz2.2 GB · 100%
At a glance
- Library
- mlx
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Dec 21, 2023
- Updated
- Dec 24, 2023
- SHA
- ee2da86e
Base models
Model card
From the Hugging Face model README
<div align="center">
TinyLlama-1.1B
</div>https://github.com/jzhang38/TinyLlama
The TinyLlama project aims to pretrain a 1.1B Llama model on 3 trillion tokens. This repository contains the TinyLlama-1.1B-Chat-v0.6 weights in npz format suitable for use with Apple's MLX framework. For more information about the model, please review its model card
How to use
pip install mlx
pip install huggingface_hub
git clone https://github.com/ml-explore/mlx-examples.git
cd mlx-examples
huggingface-cli download --local-dir-use-symlinks False --local-dir tinyllama-1.1B-Chat-v0.6 mlx-community/tinyllama-1.1B-Chat-v0.6
# Run example
python llms/llama/llama.py --model-path tinyllama-1.1B-Chat-v0.6 --prompt "My name is"
- Library
- mlx
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Dec 21, 2023
- Updated
- Dec 24, 2023