Downloads · 30 days
9
36% of all-time downloads
isiroai/Llama-3.1-8B-Instruct-TIC
Llama-3.1-8B-Instruct-TIC is a text generation model from isiroai. Use it when you need the model to write or continue text. The card lists the license as llama3.1.
Bit-exact lossless .tic compression of meta-llama/Llama-3.1-8B-Instruct.
Downloads · 30 days
9
36% of all-time downloads
All-time downloads
25
Public
Repo size
11.4 GB
Likes
0
Public
Click a slice to open those files.
.tic11.4 GB · 100%
From the Hugging Face model README
Bit-exact lossless .tic compression of meta-llama/Llama-3.1-8B-Instruct.
Same weights. No quantization.
| Precision | BF16 |
| Raw weights | 16.06 GB |
.tic weights | 11.44 GB (28.8% savings) |
Benchmarks for methodology and results.
# Install
curl -fsSL https://isiro.ai/install.sh | sh
# Download .tic bundle
pip install -U huggingface_hub
hf download isiroai/Llama-3.1-8B-Instruct-TIC --local-dir Llama-3.1-8B-Instruct-TIC
# Serve (vLLM supported today)
isiro serve Llama-3.1-8B-Instruct-TIC --target vllm
Install options · Serve docs · Compile your own
Bit-exact checks. Hash manifest: model.tic.manifest.json.
# Confirm .tic integrity via the hash manifest
isiro verify Llama-3.1-8B-Instruct-TIC
# Optional: confirm .tic weights match the raw weights (requires compiler)
hf download meta-llama/Llama-3.1-8B-Instruct --local-dir Llama-3.1-8B-Instruct
isiro verify Llama-3.1-8B-Instruct-TIC -r Llama-3.1-8B-Instruct
Weights: same license as meta-llama/Llama-3.1-8B-Instruct (Llama 3.1 Community License). See also USE_POLICY.md.
.tic, ISIRO Runtime, and Compiler: ISIRO EULA.