Downloads · 30 days
7
6% of all-time downloads
llama-2-13b-hf-smooth
jsyeom/llama-2-13b-hf-smooth
llama-2-13b-hf-smooth is a machine learning model from jsyeom. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model has SmoothQuant smoothing applied. No quantization has been applied.
All-time downloads
112
Public
Parameters
13B
26 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors26 GB · 100%
At a glance
- Model type
- llama
- Access
- Public
- Created
- Mar 24, 2026
- Updated
- Mar 24, 2026
- SHA
- 86b524ed
Base models
Model card
From the Hugging Face model README
llama-2-13b-hf-smooth
This model has SmoothQuant smoothing applied. No quantization has been applied.
Smoothing Configuration
| Parameter | Value |
|---|---|
| Base model | meta-llama/Llama-2-13b-hf |
| Smoothing alpha(migration strength) | 0.85 |
| Act scales source | mit-han-lab/smoothquant-scales |
| Quantization | None (smoothing only) |
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("jsyeom/llama-2-13b-hf-smooth")
tokenizer = AutoTokenizer.from_pretrained("jsyeom/llama-2-13b-hf-smooth")
- Type
- llama
- Languages
- en
- Created
- Mar 24, 2026
- Updated
- Mar 24, 2026