Downloads · 30 days
26
9% of all-time downloads
DeepSeek-R1-14B-IndraBit-APoT
SoloHacker007/DeepSeek-R1-14B-IndraBit-APoT
DeepSeek-R1-14B-IndraBit-APoT is a machine learning model from SoloHacker007. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model was converted using the Indra-Bit multiplier-free quantization scheme.
All-time downloads
304
Public
Parameters
14.8B
29.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors29.5 GB · 100%
At a glance
- Model type
- llama
- Access
- Public
- Created
- May 16, 2026
- Updated
- May 16, 2026
- SHA
- 62fd26b4
Base models
Model card
From the Hugging Face model README
Indra-Bit APoT Quantized: DeepSeek-R1-Distill-Llama-70B
This model was converted using the Indra-Bit multiplier-free quantization scheme.
What is Indra-Bit?
Instead of floating-point matrix multiplication, every weight is stored as a
4-term sum of powers of two: sign × (2^k1 + 2^k2 + 2^k3 + 2^k4).
This enables inference using only bit-shifts and addition — zero floating-point multiplications.
Performance
- 3.3x–4.3x speedup over FP32 on CPU (AMD Ryzen 5 5600H, single-threaded)
- ~50% memory reduction (weights stored as float16 APoT)
- 0 floating-point multiply operations during inference
Source
Converted by the Indra-Bit project: https://github.com/karanmertiya/indra_bit_engine
- Type
- llama
- Created
- May 16, 2026
- Updated
- May 16, 2026