Downloads · 30 days
6
17% of all-time downloads
amnibro/granite41-8b-gf17-atex
granite41-8b-gf17-atex is a machine learning model from amnibro. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GPU-resident int4-group (group-128) ATEX bake of IBM's Apache-2.0 granite-4.1-8b, for Adam (texture-native local AI). Standard GQA attention, ~5.9 GB resident, fits a 16 GB GPU with headroom. Decode-on-kernel (int4grp…
Downloads · 30 days
6
17% of all-time downloads
All-time downloads
35
Public
Parameters
4.9B
5.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors5.9 GB · 100%
How the weights are stored.
U84B · 82%
From the Hugging Face model README
GPU-resident int4-group (group-128) ATEX bake of IBM's Apache-2.0 granite-4.1-8b, for Adam (texture-native local AI). Standard GQA attention, ~5.9 GB resident, fits a 16 GB GPU with headroom. Decode-on-kernel (int4grp_gemv); codes decode bit-exactly (roundtrip maxerr 0.0) to the quantized weights.
Why this is Adam's default heavy model: ~2.5x faster decode than the prior NVFP4-12B, graph-friendly standard attention, and IBM reports the 8B matches their 32B-A9B MoE on quality. Logicality verified across math/physics/code/logic.
from huggingface_hub import snapshot_download
snapshot_download(repo_id='amnibro/granite41-8b-gf17-atex', local_dir='./bakes/granite41_8b_gf17_atex')
Inherits Apache 2.0 from upstream Granite 4.1. Adam (the surrounding code) is CC BY-NC 4.0 — see the GitHub repo.