Downloads · 30 days
15
3% of all-time downloads
TinyLlama-1.1B-Chat-v1.0
aneforge/TinyLlama-1.1B-Chat-v1.0
TinyLlama-1.1B-Chat-v1.0 is a text generation model from aneforge. Use it when you need the model to write or continue text. It is set up for aneforge. The card lists the license as apache-2.0.
An unmodified duplicate of TinyLlama/TinyLlama-1.1B-Chat-v1.0, tagged for use with ANEForge so the weights load and run directly on the Apple Neural Engine (no CoreML). Weights are byte-identical to the source; see th…
All-time downloads
563
Public
Parameters
1.1B
2.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- aneforge
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Aug 30, 2026
- Updated
- Aug 31, 2026
- SHA
- 31254cd3
Try a prompt
Base models
Model card
From the Hugging Face model README
TinyLlama 1.1B Chat v1.0 (ANEForge)
An unmodified duplicate of TinyLlama/TinyLlama-1.1B-Chat-v1.0, tagged for use with
ANEForge so the weights load and run directly on the
Apple Neural Engine (no CoreML). Weights are byte-identical to the source; see the original repo for
the model details. Licensed apache-2.0 from the source.
Use with ANEForge
# pip install "aneforge[models]"
import aneforge as af
from transformers import AutoTokenizer
tok = AutoTokenizer.from_pretrained("aneforge/TinyLlama-1.1B-Chat-v1.0")
model = af.load_llm("aneforge/TinyLlama-1.1B-Chat-v1.0") # prefill + resident-KV-cache decode on the ANE
ids = tok.encode("The Neural Engine is")
print(tok.decode(model.generate(ids, max_new_tokens=20)))
ANEForge compiles the model's graph into a single ANE program and streams the weights from this repo
via huggingface_hub. See the docs and the paper.
- Task
- Text Generation
- Library
- aneforge
- Type
- llama
- License
- apache-2.0
- Created
- Aug 30, 2026
- Updated
- Aug 31, 2026