torch2.12-cu133-cp312-wheels

PyTorch 2.12.0 + CUDA 13.3 Prebuilt Wheels (cp312)

Prebuilt Linux x86_64 Python wheels for the PyTorch 2.12.0 / CUDA 13.3 GPU stack, compiled against CPython 3.12 (cp312). These let you skip multi-hour source builds of flash-attn, causal-conv1d, triton, torchao, and friends on CUDA 13.3.

⚠️ These are not a model — this repo hosts Python .whl files. The HF "model" repo type is used purely as LFS-backed storage.

Build matrix

Build environment

Runtime requirement: the linux_x86_64 wheels (torch, flash-attn, causal-conv1d, bitsandbytes, torchao, torch{audio,vision}, mslk) are glibc ≥ 2.39 builds — they need a distro at least as new as Ubuntu 24.04 / Debian 13 / RHEL 10. Older glibc will fail to load them. triton is manylinux_2_27/manylinux_2_28 and is more portable (glibc ≥ 2.28).

Target GPU architectures

Wheels

CUDA arches below are the SM targets verified from the compiled binaries (cuobjdump), not just the requested build list.

Installation

Requires Python 3.12 on Linux x86_64 with an NVIDIA driver supporting CUDA 13.3.

Install torch first so the other wheels resolve against it:

# 1. Grab the wheels
pip install huggingface_hub
hf download thad0ctor/torch2.12-cu133-cp312-wheels --local-dir wheels --repo-type model

# 2. Install torch first, then the rest
pip install wheels/torch-2.12.0+cu133-cp312-cp312-linux_x86_64.whl
pip install wheels/*.whl

Or install a single wheel straight from the Hub:

pip install \
  https://huggingface.co/thad0ctor/torch2.12-cu133-cp312-wheels/resolve/main/flash_attn-2.8.3+torch2.12.0.cu133-cp312-cp312-linux_x86_64.whl

Notes

• Local version tags (e.g. +torch2.12.0.cu133) encode the exact torch/CUDA combo the wheel was built against — keep the whole stack on the same combo to avoid ABI mismatches.
• torchao is built as cp310-abi3 (stable ABI) so it loads under cp312.
• Most wheels cover 8.6 → 12.0; pre-Ampere cards (sm < 8.6) are not supported.
• mslk-cuda-nightly is Blackwell-only (sm_100 / sm_120) — it will not run on Ampere/Ada/Hopper.
• triton is a JIT compiler: it bundles ptxas (incl. a Blackwell build) and compiles kernels for your actual GPU at runtime, so it has no fixed baked-in arch set.
• vllm is a from-source build off vLLM main at commit c621af169 (vcs version 0.1.dev1, i.e. an untagged dev build). Pin the exact commit if you need to reproduce this wheel — pip install vllm==0.1.dev1+gc621af169.cu133 is not resolvable from PyPI.
• flashinfer ships as two wheels — install both:
  • flashinfer-python is the pure-Python frontend (py3-none-any, portable).
  • flashinfer-jit-cache is the matching ahead-of-time precompiled kernel cache (1 GB of cubins) so you don't pay runtime JIT compilation. It is cp39-abi3 / manylinux_2_28 (glibc ≥ 2.28) and its cubins target 8.6 / 8.9 / 9.0a / 10.0a / 12.0f. The two versions must match (0.6.12).