Downloads · 30 days
5
1% of all-time downloads
isiroai/Mistral-7B-Instruct-v0.3-TIC
Mistral-7B-Instruct-v0.3-TIC is a text generation model from isiroai. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Bit-exact lossless .tic compression of mistralai/Mistral-7B-Instruct-v0.3.
Downloads · 30 days
5
1% of all-time downloads
All-time downloads
348
Public
Repo size
10.3 GB
Likes
0
Public
Click a slice to open those files.
.tic10.3 GB · 100%
From the Hugging Face model README
Bit-exact lossless .tic compression of mistralai/Mistral-7B-Instruct-v0.3.
Same weights. No quantization.
| Precision | BF16 |
| Raw weights | 14.50 GB |
.tic weights | 10.33 GB (28.8% savings) |
Benchmarks for methodology and results.
# Install
curl -fsSL https://isiro.ai/install.sh | sh
# Download .tic bundle
pip install -U huggingface_hub
hf download isiroai/Mistral-7B-Instruct-v0.3-TIC --local-dir Mistral-7B-Instruct-v0.3-TIC
# Serve (vLLM supported today)
isiro serve Mistral-7B-Instruct-v0.3-TIC --target vllm
Install options · Serve docs · Compile your own
Bit-exact checks. Hash manifest: model.tic.manifest.json.
# Confirm .tic integrity via the hash manifest
isiro verify Mistral-7B-Instruct-v0.3-TIC
# Optional: confirm .tic weights match the raw weights (requires compiler)
hf download mistralai/Mistral-7B-Instruct-v0.3 --local-dir Mistral-7B-Instruct-v0.3
isiro verify Mistral-7B-Instruct-v0.3-TIC -r Mistral-7B-Instruct-v0.3
Weights: same license as mistralai/Mistral-7B-Instruct-v0.3 (Apache-2.0).
.tic, ISIRO Runtime, and Compiler: ISIRO EULA.